Apr 17 15:47:58 devstack cinder-volume[72320]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 17 15:47:58 devstack cinder-volume[72320]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 15:47:58 devstack cinder-volume[72320]: we strongly recommend against using it for new projects. Apr 17 15:47:58 devstack cinder-volume[72320]: If you are already using Eventlet, we recommend migrating to a different Apr 17 15:47:58 devstack cinder-volume[72320]: framework. For more detail see Apr 17 15:47:58 devstack cinder-volume[72320]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 15:47:58 devstack cinder-volume[72320]: import eventlet # noqa Apr 17 15:48:00 devstack cinder-volume[72320]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72320) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 15:48:00 devstack cinder-volume[72320]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72320) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 15:48:00 devstack cinder-volume[72320]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72320) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 15:48:00 devstack cinder-volume[72320]: INFO dbcounter [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Registered counter for database cinder Apr 17 15:48:00 devstack cinder-volume[72320]: DEBUG oslo_db.sqlalchemy.engines [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG dbcounter [-] [72320] Writer thread running {{(pid=72320) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 15:48:01 devstack cinder-volume[72320]: INFO cinder.rpc [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 17 15:48:01 devstack cinder-volume[72320]: INFO cinder.rpc [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_db.sqlalchemy.engines [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:48:01 devstack cinder-volume[72320]: INFO cinder.volume.manager [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Determined volume DB was empty at startup. Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG cinder.volume.manager [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72320) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 17 15:48:01 devstack cinder-volume[72320]: INFO cinder.volume.manager [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 17 15:48:01 devstack cinder-volume[72320]: WARNING stevedore.named [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 15:48:01 devstack cinder-volume[72320]: WARNING castellan.key_manager [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 15:48:01 devstack cinder-volume[72320]: WARNING cinder.keymgr.conf_key_mgr [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG cinder.volume.drivers.lvm [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72320) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_concurrency.processutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72320) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_concurrency.processutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] CMD "cinder-rtstool verify" returned: 0 in 0.260s {{(pid=72320) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_db.sqlalchemy.engines [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:48:01 devstack cinder-volume[72320]: INFO cinder.rpc [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 17 15:48:01 devstack cinder-volume[72320]: INFO cinder.rpc [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 17 15:48:01 devstack cinder-volume[72320]: WARNING stevedore.named [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 15:48:01 devstack cinder-volume[72320]: WARNING castellan.key_manager [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 15:48:01 devstack cinder-volume[72320]: INFO cinder.volume.manager [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_db.sqlalchemy.engines [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:48:01 devstack cinder-volume[72320]: INFO oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Starting 1 workers Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Started child 72424 {{(pid=72320) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Full set of CONF: {{(pid=72320) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] ******************************************************************************** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Configuration options gathered from: {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] ================================================================================ {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] allow_availability_zone_fallback = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] allow_compression_on_image_upload = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] allowed_direct_url_schemes = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] api_rate_limit = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] auth_strategy = keystone {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] az_cache_duration = 3600 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_availability_zone = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_host = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_stats_polling_interval = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backup_api_class = cinder.backup.api.API {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backup_name_template = backup-%s {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backup_use_same_host = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backup_use_temp_snapshot = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] chap_password = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] chap_username = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_internal_tenant_project_id = bfada644181f48279a89daef6d575cf6 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_internal_tenant_user_id = d423d315e1134b5181cf5f6af809007a {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cloned_volume_same_az = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cluster = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] compression_format = gzip {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] compute_api_class = cinder.compute.nova.API {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] config_dir = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] config_source = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] control_exchange = openstack {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] debug = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] default_availability_zone = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] default_group_type = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] default_volume_type = lvmdriver-1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] disk_geometry = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] driver_client_cert = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] driver_client_cert_key = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] driver_data_namespace = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] driver_ssl_cert_path = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] driver_ssl_cert_verify = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] driver_use_ssl = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] enable_force_upload = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] enable_new_services = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] enable_unsupported_driver = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] enforce_multipath_for_image_xfer = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72424]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] filter_function = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_api_insecure = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_api_ssl_compression = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_ca_certificates_file = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_catalog_info = image:glance:publicURL {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_num_retries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance_request_timeout = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] goodness_function = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] graceful_shutdown_timeout = 5 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] group_api_class = cinder.group.api.API {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] host = devstack {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_compress_on_upload = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_conversion_address_space_limit = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_conversion_cpu_limit = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_conversion_disable = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_upload_use_cinder_backend = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_upload_use_internal_tenant = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_volume_cache_enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_volume_cache_max_count = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] image_volume_cache_max_size_gb = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] init_host_max_objects_retrieval = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] instance_format = [instance: %(uuid)s] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] iscsi_target_flags = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] iscsi_write_cache = on {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] iser_helper = tgtadm {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] iser_ip_address = 192.168.122.251 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] iser_port = 3260 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_color = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_config_append = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_dir = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_file = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_options = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_rotate_interval = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_rotate_interval_type = days {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] log_rotation_type = none {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] max_age = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] max_logfile_count = 30 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] max_logfile_size_mb = 200 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] max_over_subscription_ratio = 20.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] message_reap_interval = 86400 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] message_ttl = 2592000 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] migration_create_volume_timeout_secs = 300 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] monkey_patch = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] monkey_patch_modules = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] my_ip = 192.168.122.251 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] no_snapshot_gb_quota = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] num_iser_scan_tries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] num_shell_tries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] num_volume_device_scan_tries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] nvmeof_conn_info_version = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] nvmet_ns_id = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] nvmet_port_id = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] osapi_max_limit = 1000 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] osapi_volume_ext_list = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] osapi_volume_listen_port = 8776 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] osapi_volume_use_ssl = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] osapi_volume_workers = 2 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] per_volume_size_limit = -1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] periodic_fuzzy_delay = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] periodic_interval = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] public_endpoint = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] publish_errors = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] quota_backup_gigabytes = 1000 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] quota_backups = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72424]: INFO cinder.volume.manager [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 17 15:48:01 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] quota_gigabytes = 1000 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] quota_groups = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] quota_snapshots = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] quota_volumes = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] rate_limit_burst = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] rate_limit_except_level = CRITICAL {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] rate_limit_interval = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] reinit_driver_count = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] replication_device = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] report_discard_supported = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] report_interval = 120 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] reservation_clean_interval = 86400 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] reservation_expire = 86400 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] reserved_image_namespaces = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] reserved_percentage = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] rpc_response_timeout = 120 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] run_external_periodic_tasks = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] scst_target_driver = iscsi {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] scst_target_iqn_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_down_time = 720 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] shell_completion = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] snapshot_name_template = snapshot-%s {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] snapshot_same_host = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] split_loggers = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] state_path = /opt/stack/data/cinder {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] storage_availability_zone = nova {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] storage_protocol = iSCSI {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] syslog_log_facility = LOG_USER {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] target_helper = lioadm {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] target_ip_address = 192.168.122.251 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] target_port = 3260 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] target_protocol = iscsi {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] target_secondary_ip_addresses = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] trace_flags = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] transport_url = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] until_refresh = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] use_chap_auth = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] use_default_quota_class = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] use_journal = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] use_json = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] use_multipath_for_image_xfer = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] use_stderr = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] use_syslog = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] verify_glance_signatures = enabled {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_api_class = cinder.volume.api.API {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_backend_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_clear = zero {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_clear_ionice = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_clear_size = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_copy_bps_limit = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_dd_blocksize = 1M {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_name_template = volume-%s {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_service_inithost_offload = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volume_usage_audit_period = month {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] zoning_mode = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_concurrency.disable_process_locking = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.admin_password = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.admin_token = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.admin_user = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_port = 35357 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_protocol = https {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_section = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_type = password {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_uri = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.auth_version = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.cache = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.identity_uri = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.include_service_catalog = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.insecure = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.interface = public {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_password = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcache_username = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.region_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.service_type = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.backend = dogpile.cache.null {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.backend_argument = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.backend_expiration_time = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.config_prefix = cache.oslo {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.debug_cache_backend = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.enable_retry_client = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.enable_socket_keepalive = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.enforce_fips_mode = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.expiration_time = 600 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.hashclient_retry_attempts = 2 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.memcache_dead_retry = 300 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.memcache_pool_maxsize = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.memcache_sasl_enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.password = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.proxies = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.redis_db = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.redis_server = localhost:6379 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.retry_attempts = 2 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.retry_delay = 0.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.socket_keepalive_count = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.socket_keepalive_idle = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.socket_keepalive_interval = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.socket_timeout = 1.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.tls_allowed_ciphers = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.tls_cafile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.tls_certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.tls_enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.tls_keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cache.username = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] coordination.backend_url = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.asyncio_connection = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.asyncio_slave_connection = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.backend = sqlalchemy {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.connection = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.connection_debug = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.connection_parameters = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.connection_recycle_time = 3600 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.connection_trace = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.db_inc_retry_interval = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.db_max_retries = 20 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.db_max_retry_interval = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.db_retry_interval = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.max_overflow = 50 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.max_pool_size = 5 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.max_retries = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.mysql_wsrep_sync_wait = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.pool_timeout = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack sudo[72429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.retry_interval = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack sudo[72429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.slave_connection = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.sqlite_synchronous = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.synchronous_reader = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] database.use_db_reconnect = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.connection_string = messaging:// {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.es_doc_type = notification {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.es_scroll_size = 10000 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.es_scroll_time = 2m {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.filter_error_trace = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.hmac_keys = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.sentinel_service_name = mymaster {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.socket_timeout = 0.1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.trace_requests = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler.trace_sqlalchemy = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler_jaeger.process_tags = {} {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler_jaeger.service_name_prefix = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] profiler_otlp.service_name_prefix = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.enforce_new_defaults = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: WARNING oslo_config.cfg [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.enforce_scope = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.policy_default_rule = default {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.policy_file = policy.yaml {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] privsep_osbrick.group = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] privsep_osbrick.helper_command = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] privsep_osbrick.user = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_sys_admin.group = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_sys_admin.helper_command = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] cinder_sys_admin.user = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.auth_section = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.auth_type = password {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.cafile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.collect_timing = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.insecure = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.send_service_user_token = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.split_loggers = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] service_user.timeout = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.auth_section = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.auth_type = password {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.collect_timing = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.insecure = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.region_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.split_loggers = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] glance.timeout = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.backend_availability_zone = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.chap_password = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.chap_username = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.disk_geometry = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.driver_client_cert = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.driver_client_cert_key = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.driver_data_namespace = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.driver_use_ssl = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.extra_capabilities = {} {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.filter_function = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.goodness_function = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.iscsi_target_flags = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.iscsi_write_cache = on {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.iser_helper = tgtadm {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.iser_port = 3260 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.lvm_share_target = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.lvm_type = auto {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.num_shell_tries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.replication_device = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.report_discard_supported = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.reserved_percentage = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.target_helper = tgtadm {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.target_port = 3260 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.target_protocol = iscsi {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.trace_flags = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.unique_fqdn_network = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.use_chap_auth = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_backend_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_clear = zero {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_clear_ionice = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_clear_size = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_reports.file_event_handler = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_reports.log_dir = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.backend_host = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.chap_password = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.chap_username = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.disk_geometry = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.driver_client_cert = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.extra_capabilities = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.filter_function = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.goodness_function = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.iser_helper = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.iser_ip_address = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.iser_port = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.lvm_share_target = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.lvm_type = auto {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.num_shell_tries = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.replication_device = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.report_discard_supported = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.reserved_percentage = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.scst_target_driver = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.storage_protocol = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.target_helper = lioadm {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.target_ip_address = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.target_port = 3260 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.trace_flags = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.use_chap_auth = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_clear = zero {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_clear_size = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] lvmdriver-1.volumes_dir = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.ssl = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_notifications.driver = [] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_notifications.retry = -1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] key_manager.fixed_key = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.barbican_api_version = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.barbican_endpoint = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.barbican_endpoint_type = public {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.barbican_region_name = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.cafile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.collect_timing = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.insecure = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.number_of_retries = 60 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.retry_delay = 1 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.send_service_user_token = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.split_loggers = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.timeout = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.verify_ssl = True {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican.verify_ssl_path = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.auth_section = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.auth_type = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.cafile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.certfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.collect_timing = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.insecure = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.keyfile = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.split_loggers = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] barbican_service_user.timeout = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.approle_role_id = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.approle_secret_id = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.kv_mountpoint = secret {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.kv_path = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.kv_version = 2 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.namespace = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.root_token_id = **** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.ssl_ca_crt_file = None {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.timeout = 60.0 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.use_ssl = False {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:48:01 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] ******************************************************************************** {{(pid=72320) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 17 15:48:02 devstack sudo[72429]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:02 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:02 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:02 devstack sudo[72438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:02 devstack sudo[72438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:02 devstack sudo[72438]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:02 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.495s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:02 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:48:02 devstack cinder-volume[72424]: INFO cinder.brick.local_dev.lvm [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 17 15:48:02 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:02 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:02 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:02 devstack sudo[72658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:48:02 devstack sudo[72658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:03 devstack sudo[72658]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:03 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:03 devstack cinder-volume[72424]: DEBUG cinder.brick.local_dev.lvm [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72424) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 17 15:48:03 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:03 devstack sudo[72857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:03 devstack sudo[72857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:04 devstack sudo[72857]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:04 devstack sudo[73026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:04 devstack sudo[73026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:04 devstack sudo[73026]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.491s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:04 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:04 devstack sudo[73092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 17 15:48:04 devstack sudo[73092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:05 devstack sudo[73092]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:05 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.438s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:05 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:05 devstack sudo[73121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:48:05 devstack sudo[73121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:05 devstack sudo[73121]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:05 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:05 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:05 devstack sudo[73124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:48:05 devstack sudo[73124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:05 devstack sudo[73124]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:05 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:05 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:05 devstack sudo[73129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:48:05 devstack sudo[73129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:06 devstack sudo[73129]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:06 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:06 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:06 devstack sudo[73136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:06 devstack sudo[73136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:06 devstack sudo[73136]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:06 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:06 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:06 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:06 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:06 devstack sudo[73142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:06 devstack sudo[73142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:07 devstack sudo[73142]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:07 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:07 devstack cinder-volume[72424]: INFO cinder.volume.drivers.lvm [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 17 15:48:07 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:07 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:07 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:07 devstack sudo[73146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:07 devstack sudo[73146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:07 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.545s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:07 devstack cinder-volume[72424]: DEBUG cinder.volume.drivers.lvm [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Updating volume stats {{(pid=72424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 15:48:07 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:07 devstack sudo[73146]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:07 devstack sudo[73156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:48:07 devstack sudo[73156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:08 devstack sudo[73156]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:08 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:08 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:08 devstack sudo[73269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:48:08 devstack sudo[73269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:08 devstack sudo[73269]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:08 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:08 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:08 devstack sudo[73351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:08 devstack sudo[73351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:09 devstack sudo[73351]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:09 devstack sudo[73414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:48:09 devstack sudo[73414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:09 devstack sudo[73414]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:09 devstack cinder-volume[72424]: INFO cinder.volume.driver [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Driver hasn't implemented _init_vendor_properties() Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG cinder.volume.driver [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72424) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG oslo_db.sqlalchemy.engines [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG dbcounter [-] [72424] Writer thread running {{(pid=72424) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG cinder.db.sqlalchemy.api [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Building query based on filter {{(pid=72424) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG cinder.image.image_utils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72424) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 17 15:48:09 devstack cinder-volume[72424]: INFO cinder.keymgr.migration [None req-954f4b7b-b038-4e3e-8eda-f571d938e6e1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG cinder.volume.drivers.lvm [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Updating volume stats {{(pid=72424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 15:48:09 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:09 devstack sudo[73418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:48:09 devstack sudo[73418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:10 devstack sudo[73418]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:10 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:10 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:10 devstack sudo[73424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:48:10 devstack sudo[73424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:10 devstack sudo[73424]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:10 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:10 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:10 devstack sudo[73430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:10 devstack sudo[73430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:11 devstack sudo[73430]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:11 devstack sudo[73433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:48:11 devstack sudo[73433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:11 devstack cinder-volume[72320]: DEBUG dbcounter [-] [72320] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72320) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:48:11 devstack sudo[73433]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG cinder.manager [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Notifying Schedulers of capabilities ... {{(pid=72424) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:48:11 devstack cinder-volume[72424]: INFO cinder.volume.manager [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Driver initialization completed successfully. Apr 17 15:48:11 devstack cinder-volume[72424]: INFO cinder.manager [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Initiating service 2 cleanup Apr 17 15:48:11 devstack cinder-volume[72424]: INFO cinder.manager [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Service 2 cleanup completed. Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG cinder.service [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Creating RPC server for service cinder-volume {{(pid=72424) start /opt/stack/cinder/cinder/service.py:231}} Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG cinder.service [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72424) start /opt/stack/cinder/cinder/service.py:237}} Apr 17 15:48:11 devstack cinder-volume[72424]: INFO cinder.volume.manager [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG cinder.volume.drivers.lvm [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Updating volume stats {{(pid=72424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 15:48:11 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:11 devstack sudo[73439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:48:11 devstack sudo[73439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:12 devstack sudo[73439]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:12 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:12 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:12 devstack sudo[73443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:48:12 devstack sudo[73443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:12 devstack sudo[73443]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:12 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:12 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:12 devstack sudo[73450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:48:12 devstack sudo[73450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:13 devstack sudo[73450]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:13 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:13 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:48:13 devstack sudo[73476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:48:13 devstack sudo[73476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:48:13 devstack sudo[73476]: pam_unix(sudo:session): session closed for user root Apr 17 15:48:13 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:48:13 devstack cinder-volume[72424]: INFO cinder.volume.manager [None req-77f39cf6-e217-432d-9679-9150299f3ff4 None None] Driver post RPC initialization completed successfully. Apr 17 15:48:21 devstack cinder-volume[72424]: DEBUG dbcounter [-] [72424] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72424) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:48:23 devstack cinder-volume[72424]: DEBUG dbcounter [-] [72424] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=72424) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:49:41 devstack cinder-volume[72424]: DEBUG oslo_service.periodic_task [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72424) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:49:41 devstack cinder-volume[72424]: DEBUG cinder.volume.drivers.lvm [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Updating volume stats {{(pid=72424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 15:49:41 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:49:41 devstack sudo[78491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:49:41 devstack sudo[78491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:49:41 devstack sudo[78491]: pam_unix(sudo:session): session closed for user root Apr 17 15:49:41 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:49:41 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:49:41 devstack sudo[78494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:49:41 devstack sudo[78494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:49:42 devstack sudo[78494]: pam_unix(sudo:session): session closed for user root Apr 17 15:49:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:49:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:49:42 devstack sudo[78497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:49:42 devstack sudo[78497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:49:42 devstack sudo[78497]: pam_unix(sudo:session): session closed for user root Apr 17 15:49:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:49:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:49:42 devstack sudo[78500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:49:42 devstack sudo[78500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:49:43 devstack sudo[78500]: pam_unix(sudo:session): session closed for user root Apr 17 15:49:43 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:49:43 devstack cinder-volume[72424]: DEBUG cinder.manager [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Notifying Schedulers of capabilities ... {{(pid=72424) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:50:23 devstack cinder-volume[72424]: DEBUG dbcounter [-] [72424] Writing DB stats cinder:SELECT=1 {{(pid=72424) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:50:23 devstack cinder-volume[72424]: DEBUG dbcounter [-] [72424] Writing DB stats cinder:UPDATE=1 {{(pid=72424) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:50:41 devstack cinder-volume[72424]: DEBUG oslo_service.periodic_task [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72424) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:50:41 devstack cinder-volume[72424]: DEBUG cinder.volume.drivers.lvm [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Updating volume stats {{(pid=72424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 17 15:50:41 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:50:41 devstack sudo[80339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 17 15:50:41 devstack sudo[80339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:50:41 devstack sudo[80339]: pam_unix(sudo:session): session closed for user root Apr 17 15:50:41 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:50:41 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:50:41 devstack sudo[80343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:50:41 devstack sudo[80343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:50:42 devstack sudo[80343]: pam_unix(sudo:session): session closed for user root Apr 17 15:50:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:50:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:50:42 devstack sudo[80366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 17 15:50:42 devstack sudo[80366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:50:42 devstack sudo[80366]: pam_unix(sudo:session): session closed for user root Apr 17 15:50:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:50:42 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:50:42 devstack sudo[80375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 17 15:50:42 devstack sudo[80375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:50:43 devstack sudo[80375]: pam_unix(sudo:session): session closed for user root Apr 17 15:50:43 devstack cinder-volume[72424]: DEBUG oslo_concurrency.processutils [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72424) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:50:43 devstack cinder-volume[72424]: DEBUG cinder.manager [None req-1ea5fc55-c40e-4747-89b3-aa18d3e64799 None None] Notifying Schedulers of capabilities ... {{(pid=72424) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:51:35 devstack cinder-volume[72320]: INFO oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Caught SIGTERM, stopping children Apr 17 15:51:35 devstack cinder-volume[72320]: DEBUG oslo_concurrency.lockutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Acquiring lock "singleton_lock" {{(pid=72320) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 15:51:35 devstack cinder-volume[72320]: DEBUG oslo_concurrency.lockutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Acquired lock "singleton_lock" {{(pid=72320) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 15:51:35 devstack cinder-volume[72320]: DEBUG oslo_concurrency.lockutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Releasing lock "singleton_lock" {{(pid=72320) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 15:51:35 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Stop services. {{(pid=72320) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 17 15:51:35 devstack cinder-volume[72320]: DEBUG oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Killing children. {{(pid=72320) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 17 15:51:35 devstack cinder-volume[72320]: INFO oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Waiting on 1 children to exit Apr 17 15:51:36 devstack cinder-volume[72424]: DEBUG oslo_concurrency.lockutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Acquiring lock "singleton_lock" {{(pid=72424) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 15:51:36 devstack cinder-volume[72424]: DEBUG oslo_concurrency.lockutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Acquired lock "singleton_lock" {{(pid=72424) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 15:51:36 devstack cinder-volume[72424]: DEBUG oslo_concurrency.lockutils [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Releasing lock "singleton_lock" {{(pid=72424) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 15:51:36 devstack cinder-volume[72424]: WARNING amqp [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 15:51:36 devstack cinder-volume[72424]: WARNING amqp [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 15:51:36 devstack cinder-volume[72320]: INFO oslo_service.backend._eventlet.service [None req-afbbd97f-cbe8-4340-ae9f-1abb22655c98 None None] Child 72424 exited with status 0 Apr 17 15:51:36 devstack cinder-volume[81470]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 17 15:51:36 devstack cinder-volume[81470]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 15:51:36 devstack cinder-volume[81470]: we strongly recommend against using it for new projects. Apr 17 15:51:36 devstack cinder-volume[81470]: If you are already using Eventlet, we recommend migrating to a different Apr 17 15:51:36 devstack cinder-volume[81470]: framework. For more detail see Apr 17 15:51:36 devstack cinder-volume[81470]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 15:51:36 devstack cinder-volume[81470]: import eventlet # noqa Apr 17 15:51:38 devstack cinder-volume[81470]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 15:51:38 devstack cinder-volume[81470]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 15:51:38 devstack cinder-volume[81470]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 15:51:39 devstack cinder-volume[81470]: INFO dbcounter [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Registered counter for database cinder Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_db.sqlalchemy.engines [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG dbcounter [-] [81470] Writer thread running {{(pid=81470) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 15:51:39 devstack cinder-volume[81470]: INFO cinder.rpc [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 17 15:51:39 devstack cinder-volume[81470]: INFO cinder.rpc [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_db.sqlalchemy.engines [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:39 devstack cinder-volume[81470]: INFO cinder.volume.manager [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Determined volume DB was empty at startup. Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG cinder.volume.manager [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81470) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 17 15:51:39 devstack cinder-volume[81470]: INFO cinder.volume.manager [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 17 15:51:39 devstack cinder-volume[81470]: WARNING stevedore.named [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 15:51:39 devstack cinder-volume[81470]: WARNING castellan.key_manager [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 15:51:39 devstack cinder-volume[81470]: WARNING cinder.keymgr.conf_key_mgr [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 15:51:39 devstack cinder-volume[81470]: INFO cinder.volume.manager [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_db.sqlalchemy.engines [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:39 devstack cinder-volume[81470]: INFO oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Starting 1 workers Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Started child 81587 {{(pid=81470) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Full set of CONF: {{(pid=81470) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] ******************************************************************************** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Configuration options gathered from: {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] ================================================================================ {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] allow_availability_zone_fallback = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] allow_compression_on_image_upload = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] allowed_direct_url_schemes = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] api_rate_limit = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] auth_strategy = keystone {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_availability_zone = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_host = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_stats_polling_interval = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backup_api_class = cinder.backup.api.API {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backup_name_template = backup-%s {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backup_use_same_host = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backup_use_temp_snapshot = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] chap_password = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] chap_username = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_internal_tenant_project_id = bfada644181f48279a89daef6d575cf6 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_internal_tenant_user_id = d423d315e1134b5181cf5f6af809007a {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cluster = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] compression_format = gzip {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] compute_api_class = cinder.compute.nova.API {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] config_dir = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] config_source = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] control_exchange = openstack {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] debug = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] default_availability_zone = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] default_group_type = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] default_volume_type = QuobyteHD {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] disk_geometry = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] driver_client_cert = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] driver_client_cert_key = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] driver_data_namespace = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] driver_ssl_cert_path = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] driver_ssl_cert_verify = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] driver_use_ssl = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] enable_new_services = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] enable_unsupported_driver = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] enabled_backends = ['QuobyteHD'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] enforce_multipath_for_image_xfer = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] filter_function = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_api_insecure = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81587]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_api_ssl_compression = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_ca_certificates_file = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_catalog_info = image:glance:publicURL {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_num_retries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance_request_timeout = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] goodness_function = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] graceful_shutdown_timeout = 5 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] group_api_class = cinder.group.api.API {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] host = devstack {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_compress_on_upload = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_conversion_address_space_limit = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_conversion_cpu_limit = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_conversion_disable = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_upload_use_cinder_backend = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_upload_use_internal_tenant = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_volume_cache_enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_volume_cache_max_count = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] image_volume_cache_max_size_gb = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] init_host_max_objects_retrieval = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] instance_format = [instance: %(uuid)s] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] iscsi_target_flags = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] iscsi_write_cache = on {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] iser_helper = tgtadm {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] iser_ip_address = 192.168.122.251 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] iser_port = 3260 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_color = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_config_append = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_dir = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_file = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_options = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_rotate_interval = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_rotate_interval_type = days {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] log_rotation_type = none {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81587]: INFO cinder.volume.manager [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.remotefs [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81587) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] max_age = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] max_logfile_count = 30 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] max_logfile_size_mb = 200 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] max_over_subscription_ratio = 20.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] message_reap_interval = 86400 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] message_ttl = 2592000 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] migration_create_volume_timeout_secs = 300 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] monkey_patch = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] monkey_patch_modules = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] my_ip = 192.168.122.251 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] no_snapshot_gb_quota = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] num_iser_scan_tries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] num_shell_tries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] num_volume_device_scan_tries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] nvmeof_conn_info_version = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] nvmet_ns_id = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] nvmet_port_id = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] osapi_max_limit = 1000 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] osapi_volume_ext_list = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] osapi_volume_listen_port = 8776 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] osapi_volume_use_ssl = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] osapi_volume_workers = 2 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] per_volume_size_limit = -1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] periodic_fuzzy_delay = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] periodic_interval = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] public_endpoint = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] publish_errors = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] quota_backup_gigabytes = 1000 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] quota_backups = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] quota_gigabytes = 1000 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] quota_groups = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] quota_snapshots = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] quota_volumes = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] rate_limit_burst = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] rate_limit_except_level = CRITICAL {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] rate_limit_interval = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] reinit_driver_count = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] replication_device = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] report_discard_supported = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] report_interval = 120 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] reservation_clean_interval = 86400 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] reservation_expire = 86400 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] reserved_image_namespaces = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] reserved_percentage = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] rpc_response_timeout = 120 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] run_external_periodic_tasks = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] scst_target_driver = iscsi {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] scst_target_iqn_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_down_time = 720 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] shell_completion = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] snapshot_name_template = snapshot-%s {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] split_loggers = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] state_path = /opt/stack/data/cinder {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] storage_availability_zone = nova {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] storage_protocol = iSCSI {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] syslog_log_facility = LOG_USER {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] target_helper = lioadm {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] target_ip_address = 192.168.122.251 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] target_port = 3260 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] target_protocol = iscsi {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] target_secondary_ip_addresses = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] trace_flags = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] transport_url = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] until_refresh = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] use_chap_auth = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] use_default_quota_class = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] use_journal = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] use_json = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] use_multipath_for_image_xfer = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] use_stderr = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] use_syslog = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] verify_glance_signatures = enabled {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_api_class = cinder.volume.api.API {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_backend_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_clear = zero {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_clear_ionice = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_clear_size = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_copy_bps_limit = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_dd_blocksize = 1M {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_name_template = volume-%s {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_service_inithost_offload = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volume_usage_audit_period = month {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] zoning_mode = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_concurrency.disable_process_locking = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.admin_password = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.admin_token = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.admin_user = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_port = 35357 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_protocol = https {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_section = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_type = password {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_uri = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.auth_version = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.cache = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.identity_uri = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.include_service_catalog = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.insecure = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.interface = public {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_password = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcache_username = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.region_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.service_type = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.backend = dogpile.cache.null {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.backend_argument = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.backend_expiration_time = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.config_prefix = cache.oslo {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.debug_cache_backend = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.enable_retry_client = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.enable_socket_keepalive = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.enforce_fips_mode = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.expiration_time = 600 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.hashclient_retry_attempts = 2 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.memcache_dead_retry = 300 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.memcache_pool_maxsize = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.memcache_sasl_enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.password = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.proxies = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.redis_db = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.redis_server = localhost:6379 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.retry_attempts = 2 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.retry_delay = 0.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.socket_keepalive_count = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.socket_keepalive_idle = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.socket_keepalive_interval = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.socket_timeout = 1.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.tls_allowed_ciphers = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.tls_cafile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.tls_certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.tls_enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.tls_keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cache.username = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] coordination.backend_url = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.asyncio_connection = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.asyncio_slave_connection = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.backend = sqlalchemy {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.connection = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.connection_debug = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.connection_parameters = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.connection_recycle_time = 3600 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.connection_trace = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.db_inc_retry_interval = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.db_max_retries = 20 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.db_max_retry_interval = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.db_retry_interval = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.max_overflow = 50 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.max_pool_size = 5 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.max_retries = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.mysql_wsrep_sync_wait = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.pool_timeout = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.retry_interval = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.slave_connection = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.sqlite_synchronous = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.synchronous_reader = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] database.use_db_reconnect = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.connection_string = messaging:// {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.es_doc_type = notification {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.es_scroll_size = 10000 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.es_scroll_time = 2m {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.filter_error_trace = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.hmac_keys = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.sentinel_service_name = mymaster {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.socket_timeout = 0.1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.trace_requests = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler.trace_sqlalchemy = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler_jaeger.process_tags = {} {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler_jaeger.service_name_prefix = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] profiler_otlp.service_name_prefix = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.enforce_new_defaults = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: WARNING oslo_config.cfg [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.enforce_scope = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.policy_default_rule = default {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.policy_file = policy.yaml {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] privsep_osbrick.group = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81587) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] privsep_osbrick.helper_command = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81587]: WARNING cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81587]: WARNING cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] privsep_osbrick.user = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_sys_admin.group = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_sys_admin.helper_command = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Running cmd (subprocess): mount.quobyte {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] cinder_sys_admin.user = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.auth_section = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.auth_type = password {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.cafile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.collect_timing = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.insecure = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.send_service_user_token = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.split_loggers = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] service_user.timeout = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.auth_section = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.auth_type = password {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.collect_timing = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.insecure = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.region_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.split_loggers = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] glance.timeout = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.backend_availability_zone = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.chap_password = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.chap_username = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.disk_geometry = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.driver_client_cert = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.driver_client_cert_key = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.driver_data_namespace = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.driver_use_ssl = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.extra_capabilities = {} {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.filter_function = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.goodness_function = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.iscsi_target_flags = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.iscsi_write_cache = on {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.iser_helper = tgtadm {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.iser_port = 3260 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_host = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_login = admin {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_mount_options = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_password = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_private_key = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_share_path = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.num_shell_tries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.quobyte_volume_url = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.replication_device = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.report_discard_supported = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.reserved_percentage = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.target_helper = tgtadm {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.target_port = 3260 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.target_protocol = iscsi {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.trace_flags = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.unique_fqdn_network = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.use_chap_auth = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_backend_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_clear = zero {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_clear_ionice = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_clear_size = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_reports.file_event_handler = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_reports.log_dir = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.backend_availability_zone = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.backend_host = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.chap_password = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.chap_username = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.chiscsi_conf = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.disk_geometry = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.driver_client_cert = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.driver_data_namespace = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.driver_use_ssl = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.extra_capabilities = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.filter_function = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.goodness_function = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.iser_helper = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.iser_ip_address = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.iser_port = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.iser_target_prefix = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_host = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_login = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_mount_options = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_password = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_private_key = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_share_path = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_ssh_port = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.num_shell_tries = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.nvmet_port_id = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.replication_device = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.report_discard_supported = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.reserved_percentage = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.scst_target_driver = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.storage_protocol = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.target_helper = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.target_ip_address = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.target_port = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.target_prefix = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.target_protocol = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.trace_flags = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.use_chap_auth = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_clear = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_clear_size = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] QuobyteHD.volumes_dir = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.ssl = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_notifications.driver = [] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_notifications.retry = -1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] key_manager.fixed_key = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.barbican_api_version = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.barbican_endpoint = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.barbican_endpoint_type = public {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.barbican_region_name = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.cafile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.collect_timing = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.insecure = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.number_of_retries = 60 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.retry_delay = 1 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.send_service_user_token = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.split_loggers = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.timeout = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.verify_ssl = True {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican.verify_ssl_path = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.auth_section = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.auth_type = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.cafile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.certfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.collect_timing = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.insecure = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.keyfile = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.split_loggers = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] barbican_service_user.timeout = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.approle_role_id = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.approle_secret_id = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.kv_mountpoint = secret {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.kv_path = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.kv_version = 2 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.namespace = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.root_token_id = **** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.ssl_ca_crt_file = None {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.timeout = 60.0 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.use_ssl = False {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:39 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] ******************************************************************************** {{(pid=81470) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 17 15:51:39 devstack quobyte-client[81591]: Reading configuration file: /etc/quobyte/client.cfg Apr 17 15:51:39 devstack quobyte-client[81591]: Invalid parameters found, error: missing mount point. Apr 17 15:51:39 devstack quobyte-client[81591]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 17 15:51:39 devstack quobyte-client[81591]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81587) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:51:39 devstack cinder-volume[81587]: INFO cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc ... Apr 17 15:51:39 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b -c /etc/quobyte/client-cinder.cfg {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:39 devstack sudo[81592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b -c /etc/quobyte/client-cinder.cfg Apr 17 15:51:39 devstack sudo[81592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:40 devstack sudo[81592]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.568s {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:40 devstack cinder-volume[81587]: INFO cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc succeeded Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81587) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.576s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:40 devstack sudo[81677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:51:40 devstack sudo[81677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:40 devstack sudo[81677]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.409s {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:40 devstack cinder-volume[81587]: INFO cinder.volume.driver [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Driver hasn't implemented _init_vendor_properties() Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG cinder.volume.driver [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81587) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_db.sqlalchemy.engines [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG dbcounter [-] [81587] Writer thread running {{(pid=81587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG cinder.db.sqlalchemy.api [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Building query based on filter {{(pid=81587) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG cinder.image.image_utils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81587) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 17 15:51:40 devstack cinder-volume[81587]: INFO cinder.keymgr.migration [None req-7d6521e2-781c-42a2-85d8-b82a8b53b250 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81587) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81587) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:51:40 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:40 devstack sudo[81689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:51:40 devstack sudo[81689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:41 devstack sudo[81689]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.596s {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG cinder.manager [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Notifying Schedulers of capabilities ... {{(pid=81587) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:51:41 devstack cinder-volume[81587]: INFO cinder.volume.manager [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Driver initialization completed successfully. Apr 17 15:51:41 devstack cinder-volume[81587]: INFO cinder.manager [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Initiating service 3 cleanup Apr 17 15:51:41 devstack cinder-volume[81587]: INFO cinder.manager [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Service 3 cleanup completed. Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG cinder.service [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Creating RPC server for service cinder-volume {{(pid=81587) start /opt/stack/cinder/cinder/service.py:231}} Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG cinder.service [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81587) start /opt/stack/cinder/cinder/service.py:237}} Apr 17 15:51:41 devstack cinder-volume[81587]: INFO cinder.volume.manager [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81587) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81587) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:51:41 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:41 devstack sudo[81726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:51:41 devstack sudo[81726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:42 devstack sudo[81726]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:42 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.397s {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:42 devstack cinder-volume[81587]: INFO cinder.volume.manager [None req-f473fc54-c3e8-4779-9dc9-33492cc99601 None None] Driver post RPC initialization completed successfully. Apr 17 15:51:43 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:51:43 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:51:43 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81587) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:51:43 devstack cinder-volume[81587]: DEBUG cinder.volume.drivers.quobyte [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81587) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:51:43 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:51:43 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:43 devstack sudo[81763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:51:43 devstack sudo[81763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:43 devstack cinder-volume[81470]: INFO oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Caught SIGTERM, stopping children Apr 17 15:51:43 devstack cinder-volume[81470]: DEBUG oslo_concurrency.lockutils [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Acquiring lock "singleton_lock" {{(pid=81470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 15:51:43 devstack cinder-volume[81470]: DEBUG oslo_concurrency.lockutils [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Acquired lock "singleton_lock" {{(pid=81470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 15:51:43 devstack cinder-volume[81470]: DEBUG oslo_concurrency.lockutils [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Releasing lock "singleton_lock" {{(pid=81470) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 15:51:43 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Stop services. {{(pid=81470) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 17 15:51:43 devstack cinder-volume[81470]: DEBUG oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Killing children. {{(pid=81470) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 17 15:51:43 devstack cinder-volume[81470]: INFO oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Waiting on 1 children to exit Apr 17 15:51:44 devstack sudo[81763]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:44 devstack cinder-volume[81587]: DEBUG oslo_concurrency.processutils [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.418s {{(pid=81587) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:44 devstack cinder-volume[81587]: DEBUG cinder.manager [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Notifying Schedulers of capabilities ... {{(pid=81587) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Unable to connect to AMQP server on 192.168.122.251:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server [None req-b7e10a0f-167a-47fe-a4f8-5fd635626162 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.251:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__ Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server method() Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self._producer.publish( Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return _publish( Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server listener(*args) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server raise error_for_code( Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.251:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 17 15:51:44 devstack cinder-volume[81587]: ERROR oslo_messaging.rpc.server Apr 17 15:51:45 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Acquiring lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 15:51:45 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Acquired lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 15:51:45 devstack cinder-volume[81587]: DEBUG oslo_concurrency.lockutils [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Releasing lock "singleton_lock" {{(pid=81587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 15:51:45 devstack cinder-volume[81587]: WARNING amqp [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 15:51:45 devstack cinder-volume[81587]: WARNING amqp [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 17 15:51:45 devstack cinder-volume[81470]: INFO oslo_service.backend._eventlet.service [None req-bdabbe42-2eb5-4ee3-9cdd-327a4000bd61 None None] Child 81587 exited with status 0 Apr 17 15:51:46 devstack cinder-volume[81817]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 17 15:51:46 devstack cinder-volume[81817]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 15:51:46 devstack cinder-volume[81817]: we strongly recommend against using it for new projects. Apr 17 15:51:46 devstack cinder-volume[81817]: If you are already using Eventlet, we recommend migrating to a different Apr 17 15:51:46 devstack cinder-volume[81817]: framework. For more detail see Apr 17 15:51:46 devstack cinder-volume[81817]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 15:51:46 devstack cinder-volume[81817]: import eventlet # noqa Apr 17 15:51:47 devstack cinder-volume[81817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 17 15:51:47 devstack cinder-volume[81817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 17 15:51:47 devstack cinder-volume[81817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 17 15:51:48 devstack cinder-volume[81817]: INFO dbcounter [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Registered counter for database cinder Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_db.sqlalchemy.engines [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG dbcounter [-] [81817] Writer thread running {{(pid=81817) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 15:51:48 devstack cinder-volume[81817]: INFO cinder.rpc [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 17 15:51:48 devstack cinder-volume[81817]: INFO cinder.rpc [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_db.sqlalchemy.engines [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:48 devstack cinder-volume[81817]: INFO cinder.volume.manager [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Determined volume DB was empty at startup. Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG cinder.volume.manager [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81817) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 17 15:51:48 devstack cinder-volume[81817]: WARNING stevedore.named [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 17 15:51:48 devstack cinder-volume[81817]: WARNING castellan.key_manager [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 15:51:48 devstack cinder-volume[81817]: WARNING cinder.keymgr.conf_key_mgr [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 17 15:51:48 devstack cinder-volume[81817]: INFO cinder.volume.manager [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_db.sqlalchemy.engines [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:48 devstack cinder-volume[81817]: INFO oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Starting 1 workers Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Started child 81996 {{(pid=81817) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Full set of CONF: {{(pid=81817) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] ******************************************************************************** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Configuration options gathered from: {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] ================================================================================ {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] allow_availability_zone_fallback = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81996]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] allow_compression_on_image_upload = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] allowed_direct_url_schemes = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] api_rate_limit = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] auth_strategy = keystone {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_availability_zone = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_host = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_stats_polling_interval = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backup_api_class = cinder.backup.api.API {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backup_name_template = backup-%s {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backup_use_same_host = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backup_use_temp_snapshot = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] chap_password = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] chap_username = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_internal_tenant_project_id = bfada644181f48279a89daef6d575cf6 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_internal_tenant_user_id = d423d315e1134b5181cf5f6af809007a {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cluster = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] compression_format = gzip {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] compute_api_class = cinder.compute.nova.API {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] config_dir = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] config_source = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] control_exchange = openstack {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] debug = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] default_availability_zone = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] default_group_type = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] default_volume_type = QuobyteHD {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] disk_geometry = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] driver_client_cert = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] driver_client_cert_key = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] driver_data_namespace = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] driver_ssl_cert_path = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] driver_ssl_cert_verify = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] driver_use_ssl = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] enable_new_services = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] enable_unsupported_driver = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] enabled_backends = ['QuobyteHD'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] enforce_multipath_for_image_xfer = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] filter_function = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_api_insecure = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_api_ssl_compression = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_ca_certificates_file = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_catalog_info = image:glance:publicURL {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_num_retries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance_request_timeout = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] goodness_function = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] graceful_shutdown_timeout = 5 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] group_api_class = cinder.group.api.API {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] host = devstack {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_compress_on_upload = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_conversion_address_space_limit = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_conversion_cpu_limit = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_conversion_disable = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_upload_use_cinder_backend = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_upload_use_internal_tenant = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_volume_cache_enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_volume_cache_max_count = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] image_volume_cache_max_size_gb = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] init_host_max_objects_retrieval = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] instance_format = [instance: %(uuid)s] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] iscsi_target_flags = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] iscsi_write_cache = on {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] iser_helper = tgtadm {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] iser_ip_address = 192.168.122.251 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] iser_port = 3260 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_color = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_config_append = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_dir = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_file = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_options = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_rotate_interval = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_rotate_interval_type = days {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81996) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] log_rotation_type = none {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] max_age = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] max_logfile_count = 30 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] max_logfile_size_mb = 200 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] max_over_subscription_ratio = 20.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] message_reap_interval = 86400 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] message_ttl = 2592000 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] migration_create_volume_timeout_secs = 300 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] monkey_patch = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] monkey_patch_modules = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] my_ip = 192.168.122.251 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] no_snapshot_gb_quota = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] num_iser_scan_tries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] num_shell_tries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] num_volume_device_scan_tries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] nvmeof_conn_info_version = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] nvmet_ns_id = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] nvmet_port_id = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] osapi_max_limit = 1000 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] osapi_volume_ext_list = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] osapi_volume_listen_port = 8776 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] osapi_volume_use_ssl = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] osapi_volume_workers = 2 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] per_volume_size_limit = -1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] periodic_fuzzy_delay = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] periodic_interval = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] public_endpoint = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] publish_errors = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] quota_backup_gigabytes = 1000 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] quota_backups = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] quota_gigabytes = 1000 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] quota_groups = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] quota_snapshots = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] quota_volumes = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] rate_limit_burst = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] rate_limit_except_level = CRITICAL {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] rate_limit_interval = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] reinit_driver_count = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] replication_device = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] report_discard_supported = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] report_interval = 120 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] reservation_clean_interval = 86400 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] reservation_expire = 86400 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] reserved_image_namespaces = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] reserved_percentage = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] rpc_response_timeout = 120 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] run_external_periodic_tasks = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] scst_target_driver = iscsi {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] scst_target_iqn_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_down_time = 720 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] shell_completion = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] snapshot_name_template = snapshot-%s {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] split_loggers = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] state_path = /opt/stack/data/cinder {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] storage_availability_zone = nova {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] storage_protocol = iSCSI {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] syslog_log_facility = LOG_USER {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] target_helper = lioadm {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] target_ip_address = 192.168.122.251 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] target_port = 3260 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] target_protocol = iscsi {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] target_secondary_ip_addresses = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] trace_flags = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] transport_url = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] until_refresh = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] use_chap_auth = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] use_default_quota_class = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] use_journal = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] use_json = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] use_multipath_for_image_xfer = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] use_stderr = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] use_syslog = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] verify_glance_signatures = enabled {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_api_class = cinder.volume.api.API {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_backend_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_clear = zero {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_clear_ionice = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_clear_size = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_copy_bps_limit = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_dd_blocksize = 1M {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_name_template = volume-%s {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_service_inithost_offload = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volume_usage_audit_period = month {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] zoning_mode = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_concurrency.disable_process_locking = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.admin_password = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.admin_token = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.admin_user = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_port = 35357 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_protocol = https {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_section = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_type = password {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_uri = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.auth_version = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.cache = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.identity_uri = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.include_service_catalog = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.insecure = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.interface = public {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_password = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcache_username = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.region_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.service_type = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.backend = dogpile.cache.null {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.backend_argument = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.backend_expiration_time = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.config_prefix = cache.oslo {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.debug_cache_backend = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.enable_retry_client = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.enable_socket_keepalive = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.enforce_fips_mode = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.expiration_time = 600 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.hashclient_retry_attempts = 2 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.memcache_dead_retry = 300 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.memcache_pool_maxsize = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.memcache_sasl_enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.password = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.proxies = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.redis_db = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.redis_server = localhost:6379 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.retry_attempts = 2 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.retry_delay = 0.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.socket_keepalive_count = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.socket_keepalive_idle = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.socket_keepalive_interval = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.socket_timeout = 1.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.tls_allowed_ciphers = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.tls_cafile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.tls_certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.tls_enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.tls_keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cache.username = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] coordination.backend_url = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.asyncio_connection = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.asyncio_slave_connection = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.backend = sqlalchemy {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.connection = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.connection_debug = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.connection_parameters = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.connection_recycle_time = 3600 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.connection_trace = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.db_inc_retry_interval = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.db_max_retries = 20 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.db_max_retry_interval = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.db_retry_interval = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.max_overflow = 50 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.max_pool_size = 5 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.max_retries = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.mysql_wsrep_sync_wait = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.pool_timeout = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.retry_interval = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.slave_connection = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.sqlite_synchronous = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.synchronous_reader = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] database.use_db_reconnect = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.connection_string = messaging:// {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.es_doc_type = notification {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.es_scroll_size = 10000 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.es_scroll_time = 2m {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.filter_error_trace = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.hmac_keys = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.sentinel_service_name = mymaster {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.socket_timeout = 0.1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.trace_requests = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler.trace_sqlalchemy = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler_jaeger.process_tags = {} {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler_jaeger.service_name_prefix = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] profiler_otlp.service_name_prefix = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.enforce_new_defaults = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: WARNING oslo_config.cfg [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.enforce_scope = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.policy_default_rule = default {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.policy_file = policy.yaml {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] privsep_osbrick.group = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] privsep_osbrick.helper_command = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] privsep_osbrick.user = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_sys_admin.group = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_sys_admin.helper_command = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] cinder_sys_admin.user = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.auth_section = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.auth_type = password {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81996) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.cafile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.collect_timing = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.insecure = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.send_service_user_token = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.split_loggers = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] service_user.timeout = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.auth_section = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Running cmd (subprocess): mount.quobyte {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.auth_type = password {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.collect_timing = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.insecure = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.region_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.split_loggers = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] glance.timeout = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.backend_availability_zone = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.chap_password = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.chap_username = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.disk_geometry = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.driver_client_cert = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.driver_client_cert_key = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.driver_data_namespace = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.driver_use_ssl = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.extra_capabilities = {} {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.filter_function = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.goodness_function = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.iscsi_target_flags = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.iscsi_write_cache = on {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.iser_helper = tgtadm {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.iser_port = 3260 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_host = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_login = admin {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_mount_options = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_password = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_private_key = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_share_path = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.num_shell_tries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.quobyte_volume_url = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.replication_device = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.report_discard_supported = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.reserved_percentage = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.target_helper = tgtadm {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.target_port = 3260 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.target_protocol = iscsi {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.trace_flags = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.unique_fqdn_network = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.use_chap_auth = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_backend_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_clear = zero {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_clear_ionice = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_clear_size = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_reports.file_event_handler = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_reports.log_dir = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.backend_availability_zone = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.backend_host = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.chap_password = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.chap_username = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.chiscsi_conf = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.disk_geometry = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.driver_client_cert = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.driver_data_namespace = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.driver_use_ssl = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.extra_capabilities = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.filter_function = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.goodness_function = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.iser_helper = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.iser_ip_address = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.iser_port = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.iser_target_prefix = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_host = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_login = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_mount_options = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_password = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_private_key = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_share_path = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_ssh_port = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.num_shell_tries = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.nvmet_port_id = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.replication_device = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.report_discard_supported = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.reserved_percentage = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.scst_target_driver = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.storage_protocol = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.target_helper = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.target_ip_address = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.target_port = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack quobyte-client[82022]: Reading configuration file: /etc/quobyte/client.cfg Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.target_prefix = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.target_protocol = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack quobyte-client[82022]: Invalid parameters found, error: missing mount point. Apr 17 15:51:48 devstack quobyte-client[82022]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 17 15:51:48 devstack quobyte-client[82022]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.trace_flags = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.use_chap_auth = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_clear = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_clear_size = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] QuobyteHD.volumes_dir = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:48 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.ssl = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_notifications.driver = [] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_notifications.retry = -1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] key_manager.fixed_key = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.barbican_api_version = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.barbican_endpoint = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.barbican_endpoint_type = public {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.barbican_region_name = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.cafile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.collect_timing = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.insecure = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.number_of_retries = 60 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.retry_delay = 1 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.send_service_user_token = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.split_loggers = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.timeout = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.verify_ssl = True {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican.verify_ssl_path = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.auth_section = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.auth_type = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.cafile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.certfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack sudo[82024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.collect_timing = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.insecure = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack sudo[82024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.keyfile = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.split_loggers = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] barbican_service_user.timeout = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.approle_role_id = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.approle_secret_id = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.kv_mountpoint = secret {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.kv_path = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.kv_version = 2 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.namespace = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.root_token_id = **** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.ssl_ca_crt_file = None {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.timeout = 60.0 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.use_ssl = False {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 17 15:51:49 devstack cinder-volume[81817]: DEBUG oslo_service.backend._eventlet.service [None req-240e6914-428d-442b-b037-eff5c22520c2 None None] ******************************************************************************** {{(pid=81817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 17 15:51:49 devstack sudo[82024]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.439s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:49 devstack cinder-volume[81996]: INFO cinder.volume.driver [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Driver hasn't implemented _init_vendor_properties() Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.volume.driver [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81996) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_db.sqlalchemy.engines [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writer thread running {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.db.sqlalchemy.api [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Building query based on filter {{(pid=81996) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81996) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:49 devstack cinder-volume[81996]: INFO cinder.keymgr.migration [None req-15e6bf97-cd5c-4753-b941-44b05ccf6c87 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 17 15:51:49 devstack sudo[82051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:51:49 devstack sudo[82051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:49 devstack sudo[82051]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.384s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:51:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Driver initialization completed successfully. Apr 17 15:51:49 devstack cinder-volume[81996]: INFO cinder.manager [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Initiating service 3 cleanup Apr 17 15:51:49 devstack cinder-volume[81996]: INFO cinder.manager [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Service 3 cleanup completed. Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.service [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Creating RPC server for service cinder-volume {{(pid=81996) start /opt/stack/cinder/cinder/service.py:231}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.service [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81996) start /opt/stack/cinder/cinder/service.py:237}} Apr 17 15:51:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:51:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:51:49 devstack sudo[82062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:51:49 devstack sudo[82062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:51:50 devstack sudo[82062]: pam_unix(sudo:session): session closed for user root Apr 17 15:51:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.392s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:51:50 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b668eecf-7757-4be0-a8ad-627ec8b29479 None None] Driver post RPC initialization completed successfully. Apr 17 15:51:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c250415-07da-4585-a8ad-97e24e4d15a2 tempest-BackendsCapabilitiesAdminTestsJSON-1170685602 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81996) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 17 15:51:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f82b5ad-8cdf-488f-a431-f7774ae7cba7 tempest-BackendsCapabilitiesAdminTestsJSON-1170685602 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81996) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 17 15:51:58 devstack cinder-volume[81817]: DEBUG dbcounter [-] [81817] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81817) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:51:59 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=2 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:52:00 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:52:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-67b749e3-066e-40ba-acdb-dda9cf21ad38 tempest-GroupsV320Test-237071792 None] Group tempest-GroupsV320Test-Group-203494991: creating Apr 17 15:52:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-67b749e3-066e-40ba-acdb-dda9cf21ad38 tempest-GroupsV320Test-237071792 None] Group tempest-GroupsV320Test-Group-203494991: created successfully Apr 17 15:52:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-67b749e3-066e-40ba-acdb-dda9cf21ad38 tempest-GroupsV320Test-237071792 None] Create group completed successfully. Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Flow 'volume_create_manager' (1976d405-968f-4ddf-9c47-44d6b774b08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7fd779-f35c-48bf-86ce-6063a13f2107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7fd779-f35c-48bf-86ce-6063a13f2107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-209417533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f04181b-461f-460e-ba36-98493a87daee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f98bab98a0446479775a49e40d06646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:49Z,use_quota=True,user_id='1cfec0ee91a741d1895bc41a511150e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d57443-343a-4dde-8b6c-f1f57ae81146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d57443-343a-4dde-8b6c-f1f57ae81146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d4191e-e366-4640-9d38-3a1a2d6a0bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d4191e-e366-4640-9d38-3a1a2d6a0bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f04181b-461f-460e-ba36-98493a87daee', 'volume_name': 'volume-8f04181b-461f-460e-ba36-98493a87daee', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c661ab8-906d-4bc9-9ac6-95eb4c5dca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c661ab8-906d-4bc9-9ac6-95eb4c5dca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f9b784-6f9e-42cb-816e-3974cd2f7ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Volume 8f04181b-461f-460e-ba36-98493a87daee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f04181b-461f-460e-ba36-98493a87daee', 'volume_size': 1} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-209417533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f04181b-461f-460e-ba36-98493a87daee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f98bab98a0446479775a49e40d06646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:49Z,use_quota=True,user_id='1cfec0ee91a741d1895bc41a511150e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Creating volume 8f04181b-461f-460e-ba36-98493a87daee {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:52:48 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:48 devstack sudo[82391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee 1073741824 Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:52:48 devstack sudo[82391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Flow 'volume_create_manager' (d00d0c1e-d891-42d2-8dd0-fd775439ceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00eb4ad-2939-43cc-818e-5a016f0fb52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00eb4ad-2939-43cc-818e-5a016f0fb52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-102854949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21623567-7ba9-47c0-ae74-4db1f4d52e6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5419ecdb0a49463b937e60c12ea31cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:49Z,use_quota=True,user_id='fb2cfd3844f142d4b4eda1729224b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe82556-cfb9-4c72-ba40-cb7116a78871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe82556-cfb9-4c72-ba40-cb7116a78871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246d4b78-0270-4a87-8a51-60205dd2fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246d4b78-0270-4a87-8a51-60205dd2fd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21623567-7ba9-47c0-ae74-4db1f4d52e6c', 'volume_name': 'volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa803ae-d2f5-4272-9b08-990fad2dd1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa803ae-d2f5-4272-9b08-990fad2dd1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1370ff90-f543-40b4-b54e-210f7fd0dae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:48 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Volume 21623567-7ba9-47c0-ae74-4db1f4d52e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c', 'volume_size': 1} Apr 17 15:52:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Created reservations ['775da5e2-03c7-4eab-8742-3f3bb89fe362'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:49 devstack sudo[82396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:52:49 devstack sudo[82396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:49 devstack sudo[82391]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee 1073741824" returned: 0 in 1.032s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:49 devstack sudo[82730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee Apr 17 15:52:49 devstack sudo[82730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:50 devstack sudo[82396]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.659s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:52:50 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b5882a55-f92a-4265-8763-36e3f1ee6a48 tempest-GroupsV320Test-237071792 None] Delete group completed successfully. Apr 17 15:52:50 devstack sudo[82730]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-102854949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21623567-7ba9-47c0-ae74-4db1f4d52e6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5419ecdb0a49463b937e60c12ea31cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:49Z,use_quota=True,user_id='fb2cfd3844f142d4b4eda1729224b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Creating volume 21623567-7ba9-47c0-ae74-4db1f4d52e6c {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:52:50 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f9b784-6f9e-42cb-816e-3974cd2f7ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f04181b-461f-460e-ba36-98493a87daee', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c988a6a-a1e7-40e3-b19f-3b6243059fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:50 devstack sudo[82737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c 1073741824 Apr 17 15:52:50 devstack sudo[82737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:50 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Volume volume-8f04181b-461f-460e-ba36-98493a87daee (8f04181b-461f-460e-ba36-98493a87daee): created successfully Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c988a6a-a1e7-40e3-b19f-3b6243059fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Flow 'volume_create_manager' (1976d405-968f-4ddf-9c47-44d6b774b08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:50 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a11ca0bd-5b38-4ecc-9ece-e9e8d6796aff tempest-VolumesAdminNegativeTest-1412237543 None] Created volume successfully. Apr 17 15:52:51 devstack sudo[82737]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c 1073741824" returned: 0 in 0.727s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:51 devstack sudo[82781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c Apr 17 15:52:51 devstack sudo[82781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Acquiring lock "cinder-8f04181b-461f-460e-ba36-98493a87daee-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Lock "cinder-8f04181b-461f-460e-ba36-98493a87daee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Acquiring lock "cinder-quobyte-8f04181b-461f-460e-ba36-98493a87daee" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Lock "cinder-quobyte-8f04181b-461f-460e-ba36-98493a87daee" acquired by "delete_volume" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:52:51 devstack cinder-volume[81996]: INFO oslo.privsep.daemon [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz44cqi87/privsep.sock'] Apr 17 15:52:51 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz44cqi87/privsep.sock Apr 17 15:52:51 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:51 devstack sudo[82781]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c" returned: 0 in 0.671s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1370ff90-f543-40b4-b54e-210f7fd0dae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70082f5-a8f9-4f6a-b057-fba798fd1a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:51 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Volume volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c (21623567-7ba9-47c0-ae74-4db1f4d52e6c): created successfully Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70082f5-a8f9-4f6a-b057-fba798fd1a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Flow 'volume_create_manager' (d00d0c1e-d891-42d2-8dd0-fd775439ceb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f3bd28f7-5eb0-4da0-b585-41fea9ed3f31 tempest-VolumesTestJSON-2077425183 None] Created volume successfully. Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: Apr 17 15:52:52 devstack cinder-volume[81996]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Flow 'volume_create_manager' (0d72252f-9698-4f17-9634-ff1dde9f76ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc4e826-2000-42c4-9d89-a4e94d4aa16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc4e826-2000-42c4-9d89-a4e94d4aa16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1717686680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6970bc-4ba9-4746-b1a4-ceedb7691bc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5419ecdb0a49463b937e60c12ea31cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:53Z,use_quota=True,user_id='fb2cfd3844f142d4b4eda1729224b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb260d9-e8a3-4b42-a860-1fa86d4a72e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb260d9-e8a3-4b42-a860-1fa86d4a72e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0ae339-3428-46f4-8c59-4ab8d4c4655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0ae339-3428-46f4-8c59-4ab8d4c4655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6970bc-4ba9-4746-b1a4-ceedb7691bc0', 'volume_name': 'volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f7ed78-e689-4b1b-ac5c-6b6ecad04e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f7ed78-e689-4b1b-ac5c-6b6ecad04e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33abc29d-0ab8-4e09-a8b2-7fa745d796d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:52 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Volume cf6970bc-4ba9-4746-b1a4-ceedb7691bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0', 'volume_size': 1} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1717686680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6970bc-4ba9-4746-b1a4-ceedb7691bc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5419ecdb0a49463b937e60c12ea31cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:53Z,use_quota=True,user_id='fb2cfd3844f142d4b4eda1729224b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Creating volume cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:52:52 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:52:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:52 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:53 devstack cinder-volume[81996]: INFO oslo.privsep.daemon [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Spawned new privsep daemon via rootwrap Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Accepted privsep connection to /tmp/tmpz44cqi87/privsep.sock {{(pid=81996) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 17 15:52:53 devstack cinder-volume[81996]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 17 15:52:53 devstack cinder-volume[81996]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 17 15:52:53 devstack cinder-volume[81996]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 17 15:52:53 devstack cinder-volume[81996]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82789 Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[985139b2-1b1b-4f31-9f2b-b924ba371d4b]: (2,) {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:52:53 devstack sudo[82790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 1073741824 Apr 17 15:52:53 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17745e8-b74e-41e1-beb0-9dee9fc5fc4d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:53 devstack sudo[82793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee Apr 17 15:52:53 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:53 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee" returned: 0 in 0.591s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:53 devstack sudo[82811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee Apr 17 15:52:53 devstack sudo[82811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:53 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 1073741824" returned: 0 in 0.745s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:53 devstack sudo[82813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 Apr 17 15:52:53 devstack sudo[82813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:54 devstack sudo[82811]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8f04181b-461f-460e-ba36-98493a87daee" returned: 0 in 0.514s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Lock "cinder-quobyte-8f04181b-461f-460e-ba36-98493a87daee" released by "delete_volume" :: held 2.618s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:52:54 devstack cinder-volume[81996]: WARNING cinder.quota [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:52:54 devstack cinder-volume[81996]: WARNING cinder.quota [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Created reservations ['d36539ff-0a77-4f2d-9791-6855af42bf20', 'a36e939a-5d60-4fac-962c-10494b43d11c', '3da185aa-5602-4074-812b-44addad4c0bf', 'f0dbb223-452f-447e-9616-2b227b5ddd17'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Flow 'volume_create_manager' (7f851158-0e35-4a3f-b14f-0307edd65a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac71636-c59c-42f6-a8e1-cedaa3db436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:54 devstack sudo[82813]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0" returned: 0 in 0.562s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac71636-c59c-42f6-a8e1-cedaa3db436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-855026673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d673e3-8e50-4799-9b6a-28f1f2138b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbb1c4a864445b8ba331322ca2252f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:54Z,use_quota=True,user_id='1ead91fc3b834e2faf550444a199a2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68604c83-acda-42bf-ba93-28331965924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68604c83-acda-42bf-ba93-28331965924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966c82c3-eb29-4388-b731-8c35f3e419ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966c82c3-eb29-4388-b731-8c35f3e419ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d673e3-8e50-4799-9b6a-28f1f2138b76', 'volume_name': 'volume-11d673e3-8e50-4799-9b6a-28f1f2138b76', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68865622-8836-421c-a6e9-d9861746c954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68865622-8836-421c-a6e9-d9861746c954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ae8f01-20e6-43e9-89f5-e5deb7b8eda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:54 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Volume 11d673e3-8e50-4799-9b6a-28f1f2138b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d673e3-8e50-4799-9b6a-28f1f2138b76', 'volume_size': 1} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-855026673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d673e3-8e50-4799-9b6a-28f1f2138b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbb1c4a864445b8ba331322ca2252f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:54Z,use_quota=True,user_id='1ead91fc3b834e2faf550444a199a2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Creating volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:52:54 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:54 devstack sudo[82819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 1073741824 Apr 17 15:52:54 devstack sudo[82819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33abc29d-0ab8-4e09-a8b2-7fa745d796d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313d91b4-843b-41aa-bc3e-4fe92b5c2ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:54 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Volume volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 (cf6970bc-4ba9-4746-b1a4-ceedb7691bc0): created successfully Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313d91b4-843b-41aa-bc3e-4fe92b5c2ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Flow 'volume_create_manager' (0d72252f-9698-4f17-9634-ff1dde9f76ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:54 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-af72df17-91dd-42ae-a265-975901edb4ea tempest-VolumesTestJSON-2077425183 None] Created volume successfully. Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:54 devstack sudo[82821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:52:54 devstack sudo[82821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:55 devstack sudo[82821]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.628s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:52:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Deleted volume successfully. Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa5f57dc-afed-4374-be1a-edea1bf45c7b tempest-VolumesAdminNegativeTest-1412237543 None] Lock "cinder-8f04181b-461f-460e-ba36-98493a87daee-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:52:55 devstack sudo[82819]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 1073741824" returned: 0 in 0.991s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:55 devstack sudo[82856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 Apr 17 15:52:55 devstack sudo[82856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Flow 'volume_create_manager' (d6f9e9cc-0004-4aa0-b5d5-08a79daf19b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a5e9c6-2021-4127-913c-818589abf95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a5e9c6-2021-4127-913c-818589abf95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-480181490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5419ecdb0a49463b937e60c12ea31cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:56Z,use_quota=True,user_id='fb2cfd3844f142d4b4eda1729224b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3931b0-1245-4e26-b2fe-beeda898b24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3931b0-1245-4e26-b2fe-beeda898b24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc72c69-44f6-4382-a306-f3c586d65356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc72c69-44f6-4382-a306-f3c586d65356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83', 'volume_name': 'volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0730f97-043f-452c-a29b-5d0c3e988f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0730f97-043f-452c-a29b-5d0c3e988f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d73ddb0-8583-4f8b-afe3-a2b231a05eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:55 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Volume 13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83', 'volume_size': 1} Apr 17 15:52:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:56 devstack sudo[82856]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76" returned: 0 in 0.702s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-480181490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5419ecdb0a49463b937e60c12ea31cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:56Z,use_quota=True,user_id='fb2cfd3844f142d4b4eda1729224b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Creating volume 13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:52:56 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:56 devstack sudo[82871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 1073741824 Apr 17 15:52:56 devstack sudo[82871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ae8f01-20e6-43e9-89f5-e5deb7b8eda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d673e3-8e50-4799-9b6a-28f1f2138b76', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea9fbe4-c41f-4ce3-947a-598038c4b03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:56 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Volume volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 (11d673e3-8e50-4799-9b6a-28f1f2138b76): created successfully Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea9fbe4-c41f-4ce3-947a-598038c4b03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Flow 'volume_create_manager' (7f851158-0e35-4a3f-b14f-0307edd65a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:56 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-623934e3-4f8e-4d41-a8d8-91146ddae0c1 tempest-SnapshotsActionsTest-1411145621 None] Created volume successfully. Apr 17 15:52:56 devstack sudo[82871]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 1073741824" returned: 0 in 0.606s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:56 devstack sudo[82896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 Apr 17 15:52:56 devstack sudo[82896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:57 devstack sudo[82896]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.396s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d73ddb0-8583-4f8b-afe3-a2b231a05eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b244601c-eca2-4446-acb6-e9c54de95a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Creating offline snapshot c977245d-315a-478b-848a-578c6a9b0e2a of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:52:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Volume volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 (13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83): created successfully Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b244601c-eca2-4446-acb6-e9c54de95a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Flow 'volume_create_manager' (d6f9e9cc-0004-4aa0-b5d5-08a79daf19b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d41d4-6300-4792-a5ff-9489e91869e6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:57 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0a62d74b-729f-48e2-bb4f-637315538751 tempest-VolumesTestJSON-2077425183 None] Created volume successfully. Apr 17 15:52:57 devstack sudo[82904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 Apr 17 15:52:57 devstack sudo[82904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:57 devstack sudo[82904]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76" returned: 0 in 0.508s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:57 devstack sudo[82911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a 1G Apr 17 15:52:57 devstack sudo[82911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Flow 'volume_create_manager' (831134a8-af8e-418e-af07-75c541f78170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b1660a-e096-412c-bd1f-32a4e78fe81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b1660a-e096-412c-bd1f-32a4e78fe81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1290474826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3de1b7b-12cd-4540-be1f-60d9e5ddca1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dd6a77d492472796cf5181d8ba618f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:58Z,use_quota=True,user_id='6859a03d40b54965a8d02d1377ce8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d90f30-85c5-4756-9e9a-316615e2b20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d90f30-85c5-4756-9e9a-316615e2b20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20ff01d-d8d5-4f05-9174-6b4e9cf2674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20ff01d-d8d5-4f05-9174-6b4e9cf2674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3de1b7b-12cd-4540-be1f-60d9e5ddca1e', 'volume_name': 'volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc55aa-347e-471b-8ee3-5297202fea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc55aa-347e-471b-8ee3-5297202fea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d782257c-890e-4483-ba17-2ad7422d1a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:52:58 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Volume e3de1b7b-12cd-4540-be1f-60d9e5ddca1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e', 'volume_size': 1} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:58 devstack sudo[82911]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a 1G" returned: 0 in 0.615s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:58 devstack sudo[82918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:52:58 devstack sudo[82918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Acquiring lock "cinder-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Lock "cinder-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Acquiring lock "cinder-quobyte-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Lock "cinder-quobyte-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83" acquired by "delete_volume" :: waited 0.020s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f3d799-b710-482a-acdb-29b3dae7528a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:58 devstack sudo[82918]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.536s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:58 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a is being set with open permissions: ugo+rw Apr 17 15:52:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:58 devstack sudo[82924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 Apr 17 15:52:58 devstack sudo[82924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:58 devstack sudo[82925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:52:58 devstack sudo[82925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:59 devstack sudo[82925]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:59 devstack sudo[82924]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:59 devstack sudo[82933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.info Apr 17 15:52:59 devstack sudo[82933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83" returned: 0 in 0.553s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:59 devstack sudo[82935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83 Apr 17 15:52:59 devstack sudo[82935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:59 devstack sudo[82933]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.info" returned: 0 in 0.410s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:59 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.info is being set with open permissions: ugo+rw Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:59 devstack sudo[82939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.info Apr 17 15:52:59 devstack sudo[82939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:52:59 devstack sudo[82935]: pam_unix(sudo:session): session closed for user root Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83" returned: 0 in 0.439s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Lock "cinder-quobyte-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83" released by "delete_volume" :: held 1.018s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Created reservations ['aa5a7f68-dbbe-4e8c-9042-7f5ef54939b7', '16d0fe06-6c62-4f6a-b9b6-a363b9fae25d', 'c956118c-ba9a-4ba0-bef8-ebee8043aa86', '607df3ae-a403-498b-960c-4d6398fe388d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:52:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:52:59 devstack sudo[82941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:52:59 devstack sudo[82941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:00 devstack sudo[82939]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.info" returned: 0 in 0.435s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.029s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.127s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1290474826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3de1b7b-12cd-4540-be1f-60d9e5ddca1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dd6a77d492472796cf5181d8ba618f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:52:58Z,use_quota=True,user_id='6859a03d40b54965a8d02d1377ce8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Creating volume e3de1b7b-12cd-4540-be1f-60d9e5ddca1e {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:53:00 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:00 devstack sudo[82944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e 1073741824 Apr 17 15:53:00 devstack sudo[82944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8ec2f5ec-d26b-4e6a-bb42-b0c4eb006d33 tempest-SnapshotsActionsTest-1411145621 None] Create snapshot completed successfully Apr 17 15:53:00 devstack sudo[82941]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.448s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Deleted volume successfully. Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6bb3d87e-216f-411e-a321-0ea2ecc5a9ac tempest-VolumesTestJSON-2077425183 None] Lock "cinder-13e75d36-dfe3-4fe4-bfd0-f03dd4f75c83-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:00 devstack sudo[82944]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e 1073741824" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:00 devstack sudo[82950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e Apr 17 15:53:00 devstack sudo[82950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "cinder-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "cinder-quobyte-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-quobyte-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f91b071-30cd-4cfd-8a57-08b5b047476e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:01 devstack sudo[82952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 Apr 17 15:53:01 devstack sudo[82952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:01 devstack sudo[82950]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e" returned: 0 in 0.674s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d782257c-890e-4483-ba17-2ad7422d1a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0061273-ca62-45dd-a50b-288fb4206800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Creating offline snapshot 2d0f39fc-740a-415c-8ab0-a5241547c002 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:53:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Volume volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e (e3de1b7b-12cd-4540-be1f-60d9e5ddca1e): created successfully Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0061273-ca62-45dd-a50b-288fb4206800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Flow 'volume_create_manager' (831134a8-af8e-418e-af07-75c541f78170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6287a469-7706-453d-8ff0-68ad8fa5dd6e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:01 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d514b2b0-1810-4679-8f7c-ba6377c144c9 tempest-DeleteServersTestJSON-1979783734 None] Created volume successfully. Apr 17 15:53:01 devstack sudo[82955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:01 devstack sudo[82955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:01 devstack sudo[82952]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0" returned: 0 in 0.697s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:01 devstack sudo[82960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0 Apr 17 15:53:01 devstack sudo[82960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:02 devstack sudo[82955]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.533s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:02 devstack sudo[82965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 1G Apr 17 15:53:02 devstack sudo[82965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:02 devstack sudo[82960]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0" returned: 0 in 0.511s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-quobyte-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0" released by "delete_volume" :: held 1.230s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Created reservations ['15e73265-4c59-44bf-8081-345cbc9afc83', 'd446a675-d33b-4942-8981-9ab17604eda5', 'ff20edc1-8614-4a49-bc5a-2eb733709bb8', 'a611bbd4-e1b4-4763-9080-1881dc68ad1c'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:02 devstack sudo[82973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:02 devstack sudo[82973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:02 devstack sudo[82965]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 1G" returned: 0 in 0.630s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:02 devstack sudo[82979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 Apr 17 15:53:02 devstack sudo[82979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:02 devstack sudo[82973]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.487s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:02 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Deleted volume successfully. Apr 17 15:53:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9084f3ce-1039-49fc-94ee-e89c9e7b4255 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-cf6970bc-4ba9-4746-b1a4-ceedb7691bc0-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "cinder-21623567-7ba9-47c0-ae74-4db1f4d52e6c-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-21623567-7ba9-47c0-ae74-4db1f4d52e6c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:03 devstack sudo[82979]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "cinder-quobyte-21623567-7ba9-47c0-ae74-4db1f4d52e6c" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002" returned: 0 in 0.533s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:03 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 is being set with open permissions: ugo+rw Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-quobyte-21623567-7ba9-47c0-ae74-4db1f4d52e6c" acquired by "delete_volume" :: waited 0.022s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:03 devstack sudo[82986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 Apr 17 15:53:03 devstack sudo[82986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0f9c16-d98f-4b89-bfa9-52d30fca8a0e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:03 devstack sudo[82988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c Apr 17 15:53:03 devstack sudo[82988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:03 devstack sudo[82986]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:03 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0b96b1f0-c86e-45d1-8be1-0b4a926eed2d tempest-SnapshotsActionsTest-1411145621 None] Create snapshot completed successfully Apr 17 15:53:03 devstack sudo[82988]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c" returned: 0 in 0.624s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:03 devstack sudo[82994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c Apr 17 15:53:03 devstack sudo[82994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:04 devstack sudo[82994]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21623567-7ba9-47c0-ae74-4db1f4d52e6c" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-quobyte-21623567-7ba9-47c0-ae74-4db1f4d52e6c" released by "delete_volume" :: held 1.131s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Created reservations ['4fcd0df8-4dea-4b81-99ec-14d26b603726', 'a568491b-a505-469e-914d-eaff12de63fc', '5bf40700-149b-43e8-a57b-62cf45a77d71', '8042c41a-0a79-44cb-9d83-245f93b26498'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:04 devstack sudo[82998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:04 devstack sudo[82998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-2d0f39fc-740a-415c-8ab0-a5241547c002-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-2d0f39fc-740a-415c-8ab0-a5241547c002-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-2d0f39fc-740a-415c-8ab0-a5241547c002" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-2d0f39fc-740a-415c-8ab0-a5241547c002" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Deleting offline snapshot 2d0f39fc-740a-415c-8ab0-a5241547c002 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] snapshot_file for this snap is: volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced14c0a-c5ac-4bb1-859b-daab61f09e92]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:05 devstack sudo[82998]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.574s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Deleted volume successfully. Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e237aa1-b610-4329-9165-d0ffe0358d85 tempest-VolumesTestJSON-2077425183 None] Lock "cinder-21623567-7ba9-47c0-ae74-4db1f4d52e6c-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:05 devstack sudo[83002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 Apr 17 15:53:05 devstack sudo[83002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:05 devstack sudo[83002]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002" returned: 0 in 0.570s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb1509e-13ad-4ce6-86c7-c01ce1d76723]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:05 devstack sudo[83010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:05 devstack sudo[83010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:06 devstack sudo[83010]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.619s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:06 devstack sudo[83018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 Apr 17 15:53:06 devstack sudo[83018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:06 devstack sudo[83018]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002" returned: 0 in 0.622s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:06 devstack sudo[83027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002 Apr 17 15:53:06 devstack sudo[83027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:07 devstack cinder-volume[81996]: WARNING py.warnings [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 17 15:53:07 devstack cinder-volume[81996]: .first() Apr 17 15:53:07 devstack cinder-volume[81996]: Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a745fd5b-957e-4de7-ae57-544b4d44f77d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:07 devstack sudo[83037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e Apr 17 15:53:07 devstack sudo[83037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:07 devstack sudo[83027]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.2d0f39fc-740a-415c-8ab0-a5241547c002" returned: 0 in 0.695s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-2d0f39fc-740a-415c-8ab0-a5241547c002" released by "_delete_snapshot" :: held 2.562s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" released by "delete_snapshot" :: held 2.577s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:07 devstack cinder-volume[81996]: WARNING cinder.quota [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Created reservations ['6b3cd35d-9302-4e9a-9c98-7e8341d6f7e0', '3618dd86-1656-4c23-bc7e-c13fc9b44a1b', '6a9ec536-004b-417e-9dc8-31367658d457', '2175075e-63f8-4606-9f56-d039a47c6096'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:07 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Delete snapshot completed successfully. Apr 17 15:53:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-983c4085-a464-44ce-909e-628f055a5bb1 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-2d0f39fc-740a-415c-8ab0-a5241547c002-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:08 devstack sudo[83037]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e" returned: 0 in 0.845s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc', 'name': 'volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f432319-c36f-4e3c-8bc1-6ee5816548ac', 'enforce_multipath': True} {{(pid=81996) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 17 15:53:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-47e4023b-8af1-4f78-b469-33048924b254 req-69801b48-5322-48ee-9ca3-35616443223d tempest-DeleteServersTestJSON-1979783734 None] attachment_update completed successfully. Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Creating offline snapshot 1e26de8c-aefb-4128-8927-ccffd8e429a1 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9945f1-2959-48e5-bd53-b98751887476]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:08 devstack sudo[83046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:08 devstack sudo[83046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-81028a91-ca6e-4e4a-9d0c-b5af68a2f90f tempest-GroupSnapshotsV319Test-1013204338 None] Group tempest-GroupSnapshotsV319Test-Group-904052182: creating Apr 17 15:53:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-81028a91-ca6e-4e4a-9d0c-b5af68a2f90f tempest-GroupSnapshotsV319Test-1013204338 None] Group tempest-GroupSnapshotsV319Test-Group-904052182: created successfully Apr 17 15:53:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-81028a91-ca6e-4e4a-9d0c-b5af68a2f90f tempest-GroupSnapshotsV319Test-1013204338 None] Create group completed successfully. Apr 17 15:53:09 devstack sudo[83046]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.558s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:09 devstack sudo[83117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 1G Apr 17 15:53:09 devstack sudo[83117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:09 devstack sudo[83117]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 1G" returned: 0 in 0.597s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:09 devstack sudo[83440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 Apr 17 15:53:09 devstack sudo[83440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:10 devstack sudo[83440]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:10 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 is being set with open permissions: ugo+rw Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:10 devstack sudo[83445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 Apr 17 15:53:10 devstack sudo[83445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Flow 'volume_create_manager' (3c63d202-63bb-4c3d-9c98-31187dc60943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f843bea9-bde9-4d59-a697-c5297afb81df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f843bea9-bde9-4d59-a697-c5297afb81df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1059908121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20359bd8-cd86-4b8b-9041-50a35274abba,host='devstack@QuobyteHD#QuobyteHD',id=6cc27117-e2a4-482f-af47-2f5f199ffec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7982eafedb34a17915ede5ce3ff3615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:11Z,use_quota=True,user_id='1c5e18b362234a2cbfb7841433463326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52c5964c-a0dc-4e58-b066-41338e9ef47f),volume_type_id=52c5964c-a0dc-4e58-b066-41338e9ef47f)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f216b689-bdf5-4b2e-b40d-c4d7177c9c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f216b689-bdf5-4b2e-b40d-c4d7177c9c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4203f769-3eee-4d40-bf1d-49d1407fb27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4203f769-3eee-4d40-bf1d-49d1407fb27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc27117-e2a4-482f-af47-2f5f199ffec9', 'volume_name': 'volume-6cc27117-e2a4-482f-af47-2f5f199ffec9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deff6cd8-9c17-4025-a365-9939df80a687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deff6cd8-9c17-4025-a365-9939df80a687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e3a080-1b51-4443-90b0-b7d5db070e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:10 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Volume 6cc27117-e2a4-482f-af47-2f5f199ffec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc27117-e2a4-482f-af47-2f5f199ffec9', 'volume_size': 1} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:10 devstack sudo[83445]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1" returned: 0 in 0.593s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=20359bd8-cd86-4b8b-9041-50a35274abba,created_at=2026-04-17T13:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1059908121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20359bd8-cd86-4b8b-9041-50a35274abba,host='devstack@QuobyteHD#QuobyteHD',id=6cc27117-e2a4-482f-af47-2f5f199ffec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7982eafedb34a17915ede5ce3ff3615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:11Z,use_quota=True,user_id='1c5e18b362234a2cbfb7841433463326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52c5964c-a0dc-4e58-b066-41338e9ef47f),volume_type_id=52c5964c-a0dc-4e58-b066-41338e9ef47f)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Creating volume 6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:53:10 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:53:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6109af7b-448e-403c-8703-2a5b4b092f05 tempest-SnapshotsActionsTest-1411145621 None] Create snapshot completed successfully Apr 17 15:53:10 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 1073741824 Apr 17 15:53:10 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:11 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 1073741824" returned: 0 in 0.611s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:11 devstack sudo[83454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 Apr 17 15:53:11 devstack sudo[83454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-1e26de8c-aefb-4128-8927-ccffd8e429a1-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-1e26de8c-aefb-4128-8927-ccffd8e429a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-1e26de8c-aefb-4128-8927-ccffd8e429a1" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-1e26de8c-aefb-4128-8927-ccffd8e429a1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Deleting offline snapshot 1e26de8c-aefb-4128-8927-ccffd8e429a1 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] snapshot_file for this snap is: volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[080d0b6b-2de3-4afa-95d1-1e0a183cba82]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:11 devstack sudo[83456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 Apr 17 15:53:11 devstack sudo[83456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:12 devstack sudo[83454]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9" returned: 0 in 0.652s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e3a080-1b51-4443-90b0-b7d5db070e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc27117-e2a4-482f-af47-2f5f199ffec9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b250ca5-adb8-40c1-97c7-1ed0b9742069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:12 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Volume volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 (6cc27117-e2a4-482f-af47-2f5f199ffec9): created successfully Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b250ca5-adb8-40c1-97c7-1ed0b9742069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Flow 'volume_create_manager' (3c63d202-63bb-4c3d-9c98-31187dc60943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:12 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-5f4c7e97-4e83-4367-9399-5fa6c30cab7e tempest-GroupSnapshotsV319Test-1013204338 None] Created volume successfully. Apr 17 15:53:12 devstack sudo[83456]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1" returned: 0 in 0.606s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2776f2f-4775-4dff-9bec-13ba51f5b052]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:12 devstack sudo[83462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:12 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:13 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.753s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:13 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] GroupSnapshot 2e725219-bc4e-4dfa-90df-13219ace44ed: creating. Apr 17 15:53:13 devstack sudo[83469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 Apr 17 15:53:13 devstack sudo[83469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Group snapshot 2e725219-bc4e-4dfa-90df-13219ace44ed: creating. {{(pid=81996) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Creating offline snapshot 02ebeffb-65f1-419e-9a5a-f9512aaf66b0 of volume 6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205fe26-cd19-4bfe-b52e-dcc960f41401]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:13 devstack sudo[83471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 Apr 17 15:53:13 devstack sudo[83471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:13 devstack sudo[83469]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1" returned: 0 in 0.537s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:13 devstack sudo[83476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1 Apr 17 15:53:13 devstack sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:14 devstack sudo[83471]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9" returned: 0 in 0.730s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:14 devstack sudo[83510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 1G Apr 17 15:53:14 devstack sudo[83510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:14 devstack sudo[83476]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.1e26de8c-aefb-4128-8927-ccffd8e429a1" returned: 0 in 0.475s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-1e26de8c-aefb-4128-8927-ccffd8e429a1" released by "_delete_snapshot" :: held 2.434s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" released by "delete_snapshot" :: held 2.449s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Created reservations ['3a3138e1-39a2-40d6-abc9-deec354fd0e2', '4ddae1dc-4311-45ca-bf1d-97d3478f38f5', 'a1304912-afba-4b0d-8180-23190cbfbba2', '808df8ff-4fd3-4574-8d0c-ca6b8a802651'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Delete snapshot completed successfully. Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b930d662-ec27-427d-b6b8-8ff2bf5c1a8f tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-1e26de8c-aefb-4128-8927-ccffd8e429a1-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:14 devstack sudo[83510]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 1G" returned: 0 in 0.619s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:14 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 Apr 17 15:53:14 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:15 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0" returned: 0 in 0.568s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:15 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:53:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:15 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 Apr 17 15:53:15 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:15 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0" returned: 0 in 0.493s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:15 devstack sudo[83553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.info Apr 17 15:53:15 devstack sudo[83553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:16 devstack sudo[83553]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.info" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:16 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:16 devstack sudo[83558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.info Apr 17 15:53:16 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:16 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-eef5320f-9eeb-4c96-abfc-ef6fb47e26e8 req-cfc82ba5-12a5-4d1e-b2f3-4b8ecaa9debc tempest-DeleteServersTestJSON-1979783734 None] Terminate volume connection completed successfully. Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-eef5320f-9eeb-4c96-abfc-ef6fb47e26e8 req-cfc82ba5-12a5-4d1e-b2f3-4b8ecaa9debc tempest-DeleteServersTestJSON-1979783734 None] Deleting attachment 5f432319-c36f-4e3c-8bc1-6ee5816548ac. {{(pid=81996) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 17 15:53:16 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.info" returned: 0 in 0.463s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.413s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.596s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Creating offline snapshot 126a4359-2503-44cb-b141-66d4a74c4608 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[28645c37-27e7-4fb4-9e5e-a35b536d3385]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:16 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-13f09ace-e2c1-4195-94d6-562e668b63b4 tempest-GroupSnapshotsV319Test-1013204338 None] group_snapshot 2e725219-bc4e-4dfa-90df-13219ace44ed: created successfully Apr 17 15:53:16 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:16 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:17 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.524s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:17 devstack sudo[83566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 1G Apr 17 15:53:17 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] group_snapshot 2e725219-bc4e-4dfa-90df-13219ace44ed: deleting Apr 17 15:53:17 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] group_snapshot 2e725219-bc4e-4dfa-90df-13219ace44ed: deleting {{(pid=81996) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 1G" returned: 0 in 0.675s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:18 devstack sudo[83571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 Apr 17 15:53:18 devstack sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Acquiring lock "cinder-quobyte-6cc27117-e2a4-482f-af47-2f5f199ffec9" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Lock "cinder-quobyte-6cc27117-e2a4-482f-af47-2f5f199ffec9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Acquiring lock "cinder-quobyte-02ebeffb-65f1-419e-9a5a-f9512aaf66b0" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Lock "cinder-quobyte-02ebeffb-65f1-419e-9a5a-f9512aaf66b0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Deleting offline snapshot 02ebeffb-65f1-419e-9a5a-f9512aaf66b0 of volume 6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] snapshot_file for this snap is: volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f53d9c-05ad-4cda-b055-c296425f56e2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:18 devstack sudo[83573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 Apr 17 15:53:18 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:18 devstack sudo[83571]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608" returned: 0 in 0.585s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:18 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 is being set with open permissions: ugo+rw Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:18 devstack sudo[83580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 Apr 17 15:53:18 devstack sudo[83580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:18 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0" returned: 0 in 0.594s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cc27117-e2a4-482f-af47-2f5f199ffec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e282da4a-c8d6-49a9-9d27-60052d989ebd]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:18 devstack sudo[83583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 Apr 17 15:53:18 devstack sudo[83583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:19 devstack sudo[83580]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608" returned: 0 in 0.544s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:19 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-70a35128-aebd-4591-ad7e-d469379c04a1 tempest-SnapshotsActionsTest-1411145621 None] Create snapshot completed successfully Apr 17 15:53:19 devstack sudo[83583]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9" returned: 0 in 0.673s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:19 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 Apr 17 15:53:19 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-126a4359-2503-44cb-b141-66d4a74c4608-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-126a4359-2503-44cb-b141-66d4a74c4608-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-126a4359-2503-44cb-b141-66d4a74c4608" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-126a4359-2503-44cb-b141-66d4a74c4608" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Deleting offline snapshot 126a4359-2503-44cb-b141-66d4a74c4608 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] snapshot_file for this snap is: volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ad673d-d3ae-48c0-94ab-d85719403322]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:19 devstack sudo[83591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 Apr 17 15:53:19 devstack sudo[83591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:19 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0" returned: 0 in 0.512s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:19 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0 Apr 17 15:53:19 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:20 devstack sudo[83591]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608" returned: 0 in 0.581s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a2654-544a-4cad-afea-c2c4138891ab]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:20 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:20 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Acquiring lock "cinder-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Lock "cinder-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Acquiring lock "cinder-quobyte-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Lock "cinder-quobyte-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9541ec-0f8d-4317-b6e1-027ce658c359]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:20 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9.02ebeffb-65f1-419e-9a5a-f9512aaf66b0" returned: 0 in 0.527s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Lock "cinder-quobyte-02ebeffb-65f1-419e-9a5a-f9512aaf66b0" released by "_delete_snapshot" :: held 2.369s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Lock "cinder-quobyte-6cc27117-e2a4-482f-af47-2f5f199ffec9" released by "delete_snapshot" :: held 2.386s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:20 devstack cinder-volume[81996]: WARNING cinder.quota [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1504397990 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1504397990, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:53:20 devstack cinder-volume[81996]: WARNING cinder.quota [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1504397990 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1504397990, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:53:20 devstack sudo[83604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e Apr 17 15:53:20 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] Created reservations ['2a830b3d-ede2-4a23-b865-72efa2b35791', '3f7e4db0-3950-4f96-91b0-71b9d2acfa63', 'a0622184-9a74-4b08-b276-afb482c02eb2', '77ad795f-5007-43af-bd7e-03ea1fa1d710'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-77f0a860-36f0-4a8a-a045-44c18e87470d tempest-GroupSnapshotsV319Test-1013204338 None] group_snapshot 2e725219-bc4e-4dfa-90df-13219ace44ed: deleted successfully Apr 17 15:53:20 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.626s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:20 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 Apr 17 15:53:20 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:21 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e" returned: 0 in 0.656s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:21 devstack sudo[83615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e Apr 17 15:53:21 devstack sudo[83615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:21 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608" returned: 0 in 0.586s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:21 devstack sudo[83623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608 Apr 17 15:53:21 devstack sudo[83623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Acquiring lock "cinder-quobyte-6cc27117-e2a4-482f-af47-2f5f199ffec9" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Lock "cinder-quobyte-6cc27117-e2a4-482f-af47-2f5f199ffec9" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7589bf67-5f18-4003-a66e-3614c0331191]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:21 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 Apr 17 15:53:21 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:21 devstack sudo[83615]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e" returned: 0 in 0.696s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Lock "cinder-quobyte-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e" released by "delete_volume" :: held 1.375s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Created reservations ['ad99da57-ed1d-42ea-9001-e692e9e6ad20', '72571152-ba10-4268-afad-4b5e0727efcf', 'e7d51284-4ae2-4778-81eb-defdb8d20870', 'c91a4810-0e44-41c1-9f12-eb70f03529ce'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:21 devstack sudo[83635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:21 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:22 devstack sudo[83623]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.126a4359-2503-44cb-b141-66d4a74c4608" returned: 0 in 0.742s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-126a4359-2503-44cb-b141-66d4a74c4608" released by "_delete_snapshot" :: held 2.582s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" released by "delete_snapshot" :: held 2.599s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Created reservations ['02a0ce8b-a09c-4292-98d7-5e790cbecced', '99a63459-7e46-4ef7-92cc-21df0a6f656d', 'eb159aab-2003-4664-97c6-cfca4e1249ea', '13a9897b-db3e-4dd1-b6e9-238c5fc76d62'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:22 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Delete snapshot completed successfully. Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-80654e99-4a58-40b2-b462-9350c0a95689 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-126a4359-2503-44cb-b141-66d4a74c4608-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:22 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9" returned: 0 in 0.630s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:22 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9 Apr 17 15:53:22 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:22 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:22 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Deleted volume successfully. Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d113effd-c83a-46e2-aa44-6c49544529b0 tempest-DeleteServersTestJSON-1979783734 None] Lock "cinder-e3de1b7b-12cd-4540-be1f-60d9e5ddca1e-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:22 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6cc27117-e2a4-482f-af47-2f5f199ffec9" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Lock "cinder-quobyte-6cc27117-e2a4-482f-af47-2f5f199ffec9" released by "delete_volume" :: held 1.141s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Created reservations ['8d0b5e3d-defd-49a6-86d5-c89423355414'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:22 devstack cinder-volume[81996]: WARNING cinder.quota [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1504397990 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1504397990, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Created reservations ['d90a2cc7-26f7-4e8e-b0fa-4c719a05ca78', '608f750f-ca30-4f10-91d0-3a7ccba16676', '21bb1680-3fa8-4ec6-9208-5d0bc3faa991', 'acc494e8-b09a-48fa-88d4-d95f2fa0baea'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:22 devstack sudo[83648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:22 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Creating offline snapshot 38e92b1c-a91f-4d40-b101-73b4fe15ccf9 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2de0a5-0a59-4193-b6ef-b004df623b34]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:22 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:22 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:23 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.474s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:23 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:23 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-69752c3a-c858-4a13-bcd1-f68a71c65f32 tempest-GroupSnapshotsV319Test-1013204338 None] Delete group completed successfully. Apr 17 15:53:23 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.544s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:23 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 1G Apr 17 15:53:23 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:24 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 1G" returned: 0 in 0.597s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:24 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 Apr 17 15:53:24 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:24 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9" returned: 0 in 0.571s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:24 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 is being set with open permissions: ugo+rw Apr 17 15:53:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:24 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 Apr 17 15:53:24 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:25 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9" returned: 0 in 0.588s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:25 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7aa37331-4755-4464-bf4f-7ee493e4615b tempest-SnapshotsActionsTest-1411145621 None] Create snapshot completed successfully Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-38e92b1c-a91f-4d40-b101-73b4fe15ccf9-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-38e92b1c-a91f-4d40-b101-73b4fe15ccf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Acquiring lock "cinder-quobyte-38e92b1c-a91f-4d40-b101-73b4fe15ccf9" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-38e92b1c-a91f-4d40-b101-73b4fe15ccf9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Deleting offline snapshot 38e92b1c-a91f-4d40-b101-73b4fe15ccf9 of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] snapshot_file for this snap is: volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09da08-3afd-4297-8be6-77ed4d37d504]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:26 devstack sudo[83673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 Apr 17 15:53:26 devstack sudo[83673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:26 devstack sudo[83673]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9" returned: 0 in 0.718s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b0202-9b7a-4906-af1a-81576043ab2a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:26 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:26 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:27 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.670s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:27 devstack sudo[83684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 Apr 17 15:53:27 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:28 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9" returned: 0 in 0.822s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:28 devstack sudo[83708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9 Apr 17 15:53:28 devstack sudo[83708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:29 devstack sudo[83708]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.38e92b1c-a91f-4d40-b101-73b4fe15ccf9" returned: 0 in 0.612s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-38e92b1c-a91f-4d40-b101-73b4fe15ccf9" released by "_delete_snapshot" :: held 2.881s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" released by "delete_snapshot" :: held 2.899s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Created reservations ['1fac3cf2-dc3d-4959-9047-1ba7d56ff261', 'c23e971e-8021-45eb-b8b0-3965a416ccf8', '2cae96b8-f520-4ea2-ad96-d931be11d343', '76f1cfa4-5aee-406c-845b-3177b05c14f0'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Delete snapshot completed successfully. Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1d844f8c-aa82-4f06-91bb-c7a01ffc2892 tempest-SnapshotsActionsTest-332528112 None] Lock "cinder-38e92b1c-a91f-4d40-b101-73b4fe15ccf9-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "cinder-c977245d-315a-478b-848a-578c6a9b0e2a-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-c977245d-315a-478b-848a-578c6a9b0e2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "cinder-quobyte-c977245d-315a-478b-848a-578c6a9b0e2a" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-quobyte-c977245d-315a-478b-848a-578c6a9b0e2a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Deleting offline snapshot c977245d-315a-478b-848a-578c6a9b0e2a of volume 11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] snapshot_file for this snap is: volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[92847781-e7be-4e0e-a8d0-e779224a4790]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:29 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:29 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:30 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.696s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d673e3-8e50-4799-9b6a-28f1f2138b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:53:30 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[773834de-4fc1-476e-b562-07f1d29a2d2a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:30 devstack sudo[83734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 Apr 17 15:53:30 devstack sudo[83734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:30 devstack sudo[83734]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76" returned: 0 in 0.568s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:30 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:30 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:31 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.606s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:31 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a Apr 17 15:53:31 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:32 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76.c977245d-315a-478b-848a-578c6a9b0e2a" returned: 0 in 0.582s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-quobyte-c977245d-315a-478b-848a-578c6a9b0e2a" released by "_delete_snapshot" :: held 2.532s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" released by "delete_snapshot" :: held 2.548s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Created reservations ['e8d78055-1c36-4e55-8598-ad6486ac3d29', '98a4a4e9-5e41-4955-8990-5233549acfd0', '24aafd95-fb40-4f2e-8cf6-e58c55168de6', '9018328d-31f9-442e-8ecb-c9d7cf5df470'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:32 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Delete snapshot completed successfully. Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-598b5f15-553f-4beb-b656-3ed0e30fc3fd tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-c977245d-315a-478b-848a-578c6a9b0e2a-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "cinder-11d673e3-8e50-4799-9b6a-28f1f2138b76-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-11d673e3-8e50-4799-9b6a-28f1f2138b76-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[22694eae-6097-4f6e-a03b-8ca8b0142fa3]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:33 devstack sudo[83750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 Apr 17 15:53:33 devstack sudo[83750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:33 devstack sudo[83750]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76" returned: 0 in 0.608s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:33 devstack sudo[83755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76 Apr 17 15:53:33 devstack sudo[83755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:34 devstack sudo[83755]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-11d673e3-8e50-4799-9b6a-28f1f2138b76" returned: 0 in 0.540s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-quobyte-11d673e3-8e50-4799-9b6a-28f1f2138b76" released by "delete_volume" :: held 1.192s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Created reservations ['bfab212f-0d5f-4eff-84ec-a3670049163a', 'b08943f6-f6ec-4ccc-ad31-8a413c097e02', 'a093542b-0bd7-4a94-afa7-8571c76be076', 'ba121c33-d4ab-488d-8672-42f2101fea4b'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:34 devstack sudo[83758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:34 devstack sudo[83758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:34 devstack sudo[83789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:34 devstack sudo[83789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:34 devstack sudo[83758]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.783s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Deleted volume successfully. Apr 17 15:53:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a92c87f-ccfb-4dbe-b8ed-637ab1f2ec15 tempest-SnapshotsActionsTest-1411145621 None] Lock "cinder-11d673e3-8e50-4799-9b6a-28f1f2138b76-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:35 devstack sudo[83789]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.907s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:35 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Flow 'volume_create_manager' (02d29b76-e0ef-459f-ad76-e7098b38e3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85edf6a-8b9d-421e-8196-951ebf9b0d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85edf6a-8b9d-421e-8196-951ebf9b0d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1932213921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3e545d-6085-4873-a873-9fc26bc8958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab72a55165a74fc8b6b050bd69c4cb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:40Z,use_quota=True,user_id='e160c15e59294aa5a128b14b57dcb921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8cc65f-20df-4010-9c4b-b6a05d8bb014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8cc65f-20df-4010-9c4b-b6a05d8bb014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3950a4-1d87-490e-9caf-b668d6f948da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3950a4-1d87-490e-9caf-b668d6f948da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3e545d-6085-4873-a873-9fc26bc8958f', 'volume_name': 'volume-4e3e545d-6085-4873-a873-9fc26bc8958f', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7e4026-772c-4984-8447-3663d2da3b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7e4026-772c-4984-8447-3663d2da3b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28360bb-2a93-4a74-a4c3-2c8c51f402bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Volume 4e3e545d-6085-4873-a873-9fc26bc8958f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3e545d-6085-4873-a873-9fc26bc8958f', 'volume_size': 1} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1932213921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3e545d-6085-4873-a873-9fc26bc8958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab72a55165a74fc8b6b050bd69c4cb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:40Z,use_quota=True,user_id='e160c15e59294aa5a128b14b57dcb921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Creating volume 4e3e545d-6085-4873-a873-9fc26bc8958f {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:53:39 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:39 devstack sudo[83823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f 1073741824 Apr 17 15:53:39 devstack sudo[83823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Flow 'volume_create_manager' (a53d452a-d573-4cb2-921e-f13b3f3bb9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30fb4f6-7b7e-4a2e-9a09-236c4dec8b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=120,cinder:UPDATE=121,cinder:DELETE=7,cinder:INSERT=30 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30fb4f6-7b7e-4a2e-9a09-236c4dec8b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-446448337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d35f076-021c-48e3-881d-6efe2b1da887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbfc54a80634349aac6dd77921f2b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:40Z,use_quota=True,user_id='56a381cd05cf4f38bbb5ee52a11b7404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ee55d9-72f2-43d2-a798-59deaa02d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ee55d9-72f2-43d2-a798-59deaa02d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360f63c7-bc87-44d7-9a4d-f1e45cfec2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360f63c7-bc87-44d7-9a4d-f1e45cfec2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d35f076-021c-48e3-881d-6efe2b1da887', 'volume_name': 'volume-0d35f076-021c-48e3-881d-6efe2b1da887', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2706f3d3-d01a-4841-aba6-b76710160cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2706f3d3-d01a-4841-aba6-b76710160cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1492ed37-4576-4069-9476-badf1dd61ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:39 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Volume 0d35f076-021c-48e3-881d-6efe2b1da887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d35f076-021c-48e3-881d-6efe2b1da887', 'volume_size': 1} Apr 17 15:53:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:40 devstack sudo[83823]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f 1073741824" returned: 0 in 0.548s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:40 devstack sudo[83828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f Apr 17 15:53:40 devstack sudo[83828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:40 devstack sudo[83828]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f" returned: 0 in 0.449s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-446448337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d35f076-021c-48e3-881d-6efe2b1da887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbfc54a80634349aac6dd77921f2b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:40Z,use_quota=True,user_id='56a381cd05cf4f38bbb5ee52a11b7404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Creating volume 0d35f076-021c-48e3-881d-6efe2b1da887 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:53:40 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=119,cinder:UPDATE=138,cinder:INSERT=33,cinder:DELETE=11 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28360bb-2a93-4a74-a4c3-2c8c51f402bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3e545d-6085-4873-a873-9fc26bc8958f', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4f524e-e7f0-4e23-9831-3a26c674d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:40 devstack sudo[83831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 1073741824 Apr 17 15:53:40 devstack sudo[83831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:40 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Volume volume-4e3e545d-6085-4873-a873-9fc26bc8958f (4e3e545d-6085-4873-a873-9fc26bc8958f): created successfully Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4f524e-e7f0-4e23-9831-3a26c674d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Flow 'volume_create_manager' (02d29b76-e0ef-459f-ad76-e7098b38e3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:40 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6d7d289c-ed6d-424e-b072-d32a107751d0 tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Created volume successfully. Apr 17 15:53:41 devstack sudo[83831]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 1073741824" returned: 0 in 0.503s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:41 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 Apr 17 15:53:41 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:41 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887" returned: 0 in 0.394s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1492ed37-4576-4069-9476-badf1dd61ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d35f076-021c-48e3-881d-6efe2b1da887', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0311969-dc04-4c87-8430-7db7a5b08b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:41 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Volume volume-0d35f076-021c-48e3-881d-6efe2b1da887 (0d35f076-021c-48e3-881d-6efe2b1da887): created successfully Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0311969-dc04-4c87-8430-7db7a5b08b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Flow 'volume_create_manager' (a53d452a-d573-4cb2-921e-f13b3f3bb9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3fed421f-a396-466d-bf23-f3296035ca49 tempest-VolumeQuotasAdminTestJSON-723273408 None] Created volume successfully. Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Acquiring lock "cinder-0d35f076-021c-48e3-881d-6efe2b1da887-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "cinder-0d35f076-021c-48e3-881d-6efe2b1da887-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Acquiring lock "cinder-quobyte-0d35f076-021c-48e3-881d-6efe2b1da887" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "cinder-quobyte-0d35f076-021c-48e3-881d-6efe2b1da887" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffed12a2-f48e-4c1c-8996-85a129c93ec6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:42 devstack sudo[83840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 Apr 17 15:53:42 devstack sudo[83840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Acquiring lock "cinder-4e3e545d-6085-4873-a873-9fc26bc8958f-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "cinder-4e3e545d-6085-4873-a873-9fc26bc8958f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Acquiring lock "cinder-quobyte-4e3e545d-6085-4873-a873-9fc26bc8958f" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "cinder-quobyte-4e3e545d-6085-4873-a873-9fc26bc8958f" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca09863e-3c6d-41c3-a2d7-ac7128d0eedc]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:42 devstack sudo[83842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f Apr 17 15:53:42 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:42 devstack sudo[83840]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887" returned: 0 in 0.684s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:42 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887 Apr 17 15:53:42 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:43 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d35f076-021c-48e3-881d-6efe2b1da887" returned: 0 in 0.719s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "cinder-quobyte-0d35f076-021c-48e3-881d-6efe2b1da887" released by "delete_volume" :: held 1.427s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Created reservations ['766f09eb-3bad-45e9-9acc-3bdf9e403589', 'bd4f90d8-f383-426b-b6d3-6d32eb4cfc47', '8c61dca3-9297-4759-9467-417c5df47ae1', '977cd126-4b8a-4df9-9f9b-2bff4ba034cf'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:43 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f" returned: 0 in 1.227s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:43 devstack sudo[83858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f Apr 17 15:53:43 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:43 devstack sudo[83865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:43 devstack sudo[83865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:44 devstack sudo[83865]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.550s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:44 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Deleted volume successfully. Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ecd4a877-8c01-4476-a761-2d2aa32e2c78 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "cinder-0d35f076-021c-48e3-881d-6efe2b1da887-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:44 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4e3e545d-6085-4873-a873-9fc26bc8958f" returned: 0 in 0.906s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "cinder-quobyte-4e3e545d-6085-4873-a873-9fc26bc8958f" released by "delete_volume" :: held 2.162s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Created reservations ['806c516d-4d6b-47eb-87ca-d9b3ca30e51a', 'ecdbb847-9b60-4871-980a-20fffba24bf4', '0bb4647a-450e-4576-ac35-c76996e67f55', '9dd1c1cf-31f8-42f4-b6a4-e2d948fa2cc1'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:44 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:44 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:53:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Flow 'volume_create_manager' (5f6ece23-4b7a-417b-9964-c373b4055e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d51591-5554-4cab-b440-e4d51eaac6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d51591-5554-4cab-b440-e4d51eaac6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1333911603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322d4ac5-7288-40f9-a959-72be4db0e965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbfc54a80634349aac6dd77921f2b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:45Z,use_quota=True,user_id='56a381cd05cf4f38bbb5ee52a11b7404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5419149-1ebb-4b72-a1ea-4272c1716873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5419149-1ebb-4b72-a1ea-4272c1716873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b2707a-f611-4abd-9c9b-7edaf3130964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b2707a-f611-4abd-9c9b-7edaf3130964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '322d4ac5-7288-40f9-a959-72be4db0e965', 'volume_name': 'volume-322d4ac5-7288-40f9-a959-72be4db0e965', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3c7a6b-d288-482d-b9f5-08419d204ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3c7a6b-d288-482d-b9f5-08419d204ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb969e5-d67a-4759-a306-dd9efb3bed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Volume 322d4ac5-7288-40f9-a959-72be4db0e965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-322d4ac5-7288-40f9-a959-72be4db0e965', 'volume_size': 1} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1333911603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322d4ac5-7288-40f9-a959-72be4db0e965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbfc54a80634349aac6dd77921f2b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:45Z,use_quota=True,user_id='56a381cd05cf4f38bbb5ee52a11b7404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Creating volume 322d4ac5-7288-40f9-a959-72be4db0e965 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:53:45 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:45 devstack sudo[83892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 1073741824 Apr 17 15:53:45 devstack sudo[83892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:45 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.565s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:45 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Deleted volume successfully. Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-035ed570-8039-4447-801a-6ac2d9e7ba8f tempest-VolumeQuotasNegativeTestJSON-1900078182 None] Lock "cinder-4e3e545d-6085-4873-a873-9fc26bc8958f-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:45 devstack sudo[83892]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 1073741824" returned: 0 in 0.574s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:45 devstack sudo[83898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 Apr 17 15:53:45 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:46 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965" returned: 0 in 0.718s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:53:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb969e5-d67a-4759-a306-dd9efb3bed7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-322d4ac5-7288-40f9-a959-72be4db0e965', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2204f918-69ae-4f8c-860a-8eb69117b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Volume volume-322d4ac5-7288-40f9-a959-72be4db0e965 (322d4ac5-7288-40f9-a959-72be4db0e965): created successfully Apr 17 15:53:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2204f918-69ae-4f8c-860a-8eb69117b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Flow 'volume_create_manager' (5f6ece23-4b7a-417b-9964-c373b4055e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6c110a57-7928-4263-8f18-2ab202064716 tempest-VolumeQuotasAdminTestJSON-723273408 None] Created volume successfully. Apr 17 15:53:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-68351a80-24f6-4c86-85f5-f8ec0b6362d4 tempest-VolumeQuotasAdminTestJSON-1296177435 None] Transfer volume completed successfully. Apr 17 15:53:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Acquiring lock "cinder-322d4ac5-7288-40f9-a959-72be4db0e965-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Lock "cinder-322d4ac5-7288-40f9-a959-72be4db0e965-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Acquiring lock "cinder-quobyte-322d4ac5-7288-40f9-a959-72be4db0e965" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Lock "cinder-quobyte-322d4ac5-7288-40f9-a959-72be4db0e965" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:49 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3865315a-c6fe-42f7-9f76-77c7ffc127c5]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:49 devstack sudo[83932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 Apr 17 15:53:49 devstack sudo[83932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:50 devstack sudo[83932]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965" returned: 0 in 0.947s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:50 devstack sudo[83940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965 Apr 17 15:53:50 devstack sudo[83940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:51 devstack sudo[83940]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-322d4ac5-7288-40f9-a959-72be4db0e965" returned: 0 in 1.279s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Lock "cinder-quobyte-322d4ac5-7288-40f9-a959-72be4db0e965" released by "delete_volume" :: held 2.408s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:51 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Created reservations ['35d385f8-8507-4628-9f0e-6bb734835e54', 'a9d1ed58-e244-4fe4-92e8-89c3e82810aa', '03480d8f-aaf8-4fbd-802f-29c4ed6c3459', '67ac0f38-2e30-419d-bdd9-efbc8051ef55'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:52 devstack sudo[84003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:52 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:52 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.799s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:52 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:52 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Deleted volume successfully. Apr 17 15:53:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-003362eb-8fd6-4a27-a0db-585727b2b743 tempest-VolumeQuotasAdminTestJSON-2138798394 None] Lock "cinder-322d4ac5-7288-40f9-a959-72be4db0e965-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Flow 'volume_create_manager' (1e72e7ee-552b-42f0-85a4-df327ed48de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fe38ef-d20b-4b12-bb0e-92a6f14367f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fe38ef-d20b-4b12-bb0e-92a6f14367f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2125155488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dba4f2-5544-4116-b206-6e48b9b073bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306a0951def4676893146999eb093da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:53Z,use_quota=True,user_id='82c6151fb8d94909899ed8db4f4bc0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb03c6aa-ef6e-4bc6-921d-8e1bae57bada),volume_type_id=eb03c6aa-ef6e-4bc6-921d-8e1bae57bada)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0404bf7a-adc9-4544-a2b3-e836107b8df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0404bf7a-adc9-4544-a2b3-e836107b8df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a0cfc3-af86-438a-b50a-6a570314a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a0cfc3-af86-438a-b50a-6a570314a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dba4f2-5544-4116-b206-6e48b9b073bf', 'volume_name': 'volume-f9dba4f2-5544-4116-b206-6e48b9b073bf', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b6f3c9-182d-4b74-bade-77592b3aa06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b6f3c9-182d-4b74-bade-77592b3aa06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74fe60c-83fa-406b-87e3-22d99a102884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:53 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Volume f9dba4f2-5544-4116-b206-6e48b9b073bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dba4f2-5544-4116-b206-6e48b9b073bf', 'volume_size': 1} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2125155488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dba4f2-5544-4116-b206-6e48b9b073bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306a0951def4676893146999eb093da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:53:53Z,use_quota=True,user_id='82c6151fb8d94909899ed8db4f4bc0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb03c6aa-ef6e-4bc6-921d-8e1bae57bada),volume_type_id=eb03c6aa-ef6e-4bc6-921d-8e1bae57bada)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Creating volume f9dba4f2-5544-4116-b206-6e48b9b073bf {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:53:53 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:53:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:53 devstack sudo[84031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf 1073741824 Apr 17 15:53:53 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:54 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf 1073741824" returned: 0 in 0.855s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:54 devstack sudo[84041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf Apr 17 15:53:54 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:54 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf" returned: 0 in 0.585s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74fe60c-83fa-406b-87e3-22d99a102884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dba4f2-5544-4116-b206-6e48b9b073bf', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1daf57-8516-464f-910e-42d47b83cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:54 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Volume volume-f9dba4f2-5544-4116-b206-6e48b9b073bf (f9dba4f2-5544-4116-b206-6e48b9b073bf): created successfully Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1daf57-8516-464f-910e-42d47b83cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Flow 'volume_create_manager' (1e72e7ee-552b-42f0-85a4-df327ed48de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:54 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4d00cce6-0f81-4151-9499-fe70a7eb92a7 tempest-VolumeTypesAccessTest-926728450 None] Created volume successfully. Apr 17 15:53:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Acquiring lock "cinder-f9dba4f2-5544-4116-b206-6e48b9b073bf-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Lock "cinder-f9dba4f2-5544-4116-b206-6e48b9b073bf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Acquiring lock "cinder-quobyte-f9dba4f2-5544-4116-b206-6e48b9b073bf" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:53:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Lock "cinder-quobyte-f9dba4f2-5544-4116-b206-6e48b9b073bf" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:53:55 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50fd87a-ff35-48f2-845e-6a5c72a07d80]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:53:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:55 devstack sudo[84046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf Apr 17 15:53:55 devstack sudo[84046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:56 devstack sudo[84046]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf" returned: 0 in 0.672s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:56 devstack sudo[84053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf Apr 17 15:53:56 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:57 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9dba4f2-5544-4116-b206-6e48b9b073bf" returned: 0 in 0.759s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Lock "cinder-quobyte-f9dba4f2-5544-4116-b206-6e48b9b073bf" released by "delete_volume" :: held 1.465s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:57 devstack cinder-volume[81996]: WARNING cinder.quota [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-868893144 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-868893144, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:53:57 devstack cinder-volume[81996]: WARNING cinder.quota [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-868893144 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-868893144, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Created reservations ['3b0ac937-0484-4c39-bd8d-4656720968fc', '30ff5433-310b-40df-8897-38a1c6fa11ed', '5f703421-ac6a-4a9c-a99d-f2ff2e00ba43', '9a05436b-d3ef-41ee-810f-493918dba4a5'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:57 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:53:57 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:53:58 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Apr 17 15:53:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.253s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:53:58 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:53:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Deleted volume successfully. Apr 17 15:53:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bbb624-cc6d-4c9a-97f7-b27661383bf8 tempest-VolumeTypesAccessTest-926728450 None] Lock "cinder-f9dba4f2-5544-4116-b206-6e48b9b073bf-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Flow 'volume_create_manager' (c659648c-6c13-4351-9bbb-481892e243bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c4966d-5cca-4e15-83ce-096eed401d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c4966d-5cca-4e15-83ce-096eed401d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-118612147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c729eb-32f7-4031-ae58-6ecb10cb5538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b961d04976ec4731b9c240981aa7dab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:00Z,use_quota=True,user_id='ad46eb93bdf343889c53877a49fc21ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79388ba-c518-48fa-85b6-281959c93be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79388ba-c518-48fa-85b6-281959c93be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abe361f-e3e7-443c-964e-b0e3022d7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abe361f-e3e7-443c-964e-b0e3022d7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c729eb-32f7-4031-ae58-6ecb10cb5538', 'volume_name': 'volume-70c729eb-32f7-4031-ae58-6ecb10cb5538', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0306e0-bc9e-4c8c-878e-393250cfb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0306e0-bc9e-4c8c-878e-393250cfb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fdb544-a8f0-461b-90c9-3f46936e9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:53:59 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Volume 70c729eb-32f7-4031-ae58-6ecb10cb5538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c729eb-32f7-4031-ae58-6ecb10cb5538', 'volume_size': 1} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-118612147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c729eb-32f7-4031-ae58-6ecb10cb5538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b961d04976ec4731b9c240981aa7dab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:00Z,use_quota=True,user_id='ad46eb93bdf343889c53877a49fc21ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Creating volume 70c729eb-32f7-4031-ae58-6ecb10cb5538 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:53:59 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:53:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:53:59 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 1073741824 Apr 17 15:53:59 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Flow 'volume_create_manager' (71017da0-7603-4a5b-82ce-6d8401393c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c5277-2b05-4f5c-89a0-1cdd85d3a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c5277-2b05-4f5c-89a0-1cdd85d3a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-630019433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e2a15b-d3af-4041-a441-2e5c63c1c9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f123ba0aec42a6b90205a77366b757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:01Z,use_quota=True,user_id='2a4221ad18e74cc380ee7e27719732f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b352c87-c01f-493b-855d-a73cf8fa1f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b352c87-c01f-493b-855d-a73cf8fa1f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aa9624-7734-4d02-9714-99c7cc9e5574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:00 devstack cinder-volume[81996]: DEBUG cinder.image.glance [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Creating Keystone auth plugin from conf {{(pid=81996) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 15:54:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aa9624-7734-4d02-9714-99c7cc9e5574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68e2a15b-d3af-4041-a441-2e5c63c1c9b6', 'volume_name': 'volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a96428-fde7-4352-a50c-049dd37ce35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a96428-fde7-4352-a50c-049dd37ce35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996eca88-d0ce-41ed-a05f-79756b509113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Volume 68e2a15b-d3af-4041-a441-2e5c63c1c9b6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 15:54:01 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Trying to clone 68e2a15b-d3af-4041-a441-2e5c63c1c9b6 from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]). {{(pid=81996) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 15:54:01 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 1073741824" returned: 0 in 2.103s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:02 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 15:54:02 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Image download 20.69 MB at 20.69 MB/s Apr 17 15:54:02 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea4cc78-ce38-4bd1-8399-5ba9353c9c8e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:02 devstack sudo[84141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 Apr 17 15:54:02 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:02 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD Apr 17 15:54:02 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:03 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538" returned: 0 in 1.032s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] <== create_volume: return (3257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.261s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fdb544-a8f0-461b-90c9-3f46936e9932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c729eb-32f7-4031-ae58-6ecb10cb5538', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c6c5da-e40b-4645-ae7c-9b477945373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:03 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Volume volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 (70c729eb-32f7-4031-ae58-6ecb10cb5538): created successfully Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c6c5da-e40b-4645-ae7c-9b477945373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Flow 'volume_create_manager' (c659648c-6c13-4351-9bbb-481892e243bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:03 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3b50d420-754c-4068-952a-bcd0fbe26e25 tempest-ServerRescueNegativeTestJSON-386995723 None] Created volume successfully. Apr 17 15:54:03 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD" returned: 0 in 1.234s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 is fetched for user 2a4221ad18e74cc380ee7e27719732f2. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f88648-aefd-49a1-89ab-c404d71c591d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:03 devstack sudo[84149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD Apr 17 15:54:03 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:04 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-630019433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e2a15b-d3af-4041-a441-2e5c63c1c9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f123ba0aec42a6b90205a77366b757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:01Z,use_quota=True,user_id='2a4221ad18e74cc380ee7e27719732f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Creating volume 68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:04 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:04 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 1073741824 Apr 17 15:54:04 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:05 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 1073741824" returned: 0 in 1.150s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:05 devstack sudo[84165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 Apr 17 15:54:05 devstack sudo[84165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:06 devstack sudo[84165]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" returned: 0 in 0.812s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:06 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Attempting download of cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume 68e2a15b-d3af-4041-a441-2e5c63c1c9b6. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 15:54:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7321e35f-cafa-4ec2-b87b-adf22f0778a6]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ddyvjyqw {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:06 devstack sudo[84171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ddyvjyqw Apr 17 15:54:06 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:07 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ddyvjyqw" returned: 0 in 0.663s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ddyvjyqw {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:07 devstack sudo[84176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ddyvjyqw Apr 17 15:54:07 devstack sudo[84176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:07 devstack sudo[84176]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ddyvjyqw" returned: 1 in 0.807s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ddyvjyqw' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:54:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e283ee0-b491-45dd-9e02-cc93cf39628a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:07 devstack sudo[84180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD Apr 17 15:54:07 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:08 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:08 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] cc5467f8-7dfc-439a-a775-b07f14ef45d1 was qcow2, converting to raw {{(pid=81996) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 15:54:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:08 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 Apr 17 15:54:08 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:10 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" returned: 0 in 1.806s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:10 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_mzhk5wuldevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:54:10 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Converted 112.00 MB image at 61.98 MB/s Apr 17 15:54:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:10 devstack sudo[84230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 1G Apr 17 15:54:10 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:11 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Flow 'volume_create_manager' (0c23689b-9303-427f-9bbd-728ff2f9de6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e940817-7fb2-480f-a967-88ba874ec091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e940817-7fb2-480f-a967-88ba874ec091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:12Z,deleted=False,deleted_at=None,display_description='',display_name='bf4d2577-3bd4-4d0e-94ba-f6c2926f79d0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cd3a95-9404-42c8-b31b-238ebab9eef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1ef2791b2a48d1bd44343cb72225c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:12Z,use_quota=True,user_id='0ed1a57bec68414baa9267474dcfab33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1553ad7f-cbd2-4368-b628-1b10f306623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1553ad7f-cbd2-4368-b628-1b10f306623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410944eb-3393-42c8-90d6-4c9ee0a041e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410944eb-3393-42c8-90d6-4c9ee0a041e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0cd3a95-9404-42c8-b31b-238ebab9eef9', 'volume_name': 'volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db468810-84d8-4876-b937-4fbe2abe92a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db468810-84d8-4876-b937-4fbe2abe92a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba18c52-aef1-43b2-a860-3fe99936ab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:11 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Volume b0cd3a95-9404-42c8-b31b-238ebab9eef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9', 'volume_size': 1} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:12Z,deleted=False,deleted_at=None,display_description='',display_name='bf4d2577-3bd4-4d0e-94ba-f6c2926f79d0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cd3a95-9404-42c8-b31b-238ebab9eef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1ef2791b2a48d1bd44343cb72225c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:12Z,use_quota=True,user_id='0ed1a57bec68414baa9267474dcfab33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Creating volume b0cd3a95-9404-42c8-b31b-238ebab9eef9 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:12 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 1G" returned: 0 in 1.582s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:12 devstack sudo[84236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 1073741824 Apr 17 15:54:12 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd66a8-2be6-4050-829e-d891a041e06e]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:12 devstack sudo[84239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 Apr 17 15:54:12 devstack sudo[84239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:13 devstack sudo[84239]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" returned: 0 in 1.074s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:13 devstack sudo[84248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 Apr 17 15:54:13 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:13 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 1073741824" returned: 0 in 1.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:13 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 Apr 17 15:54:13 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:14 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" returned: 1 in 1.242s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Downloaded image cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume 68e2a15b-d3af-4041-a441-2e5c63c1c9b6 successfully. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 for user 2a4221ad18e74cc380ee7e27719732f2 is deleted. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Marking volume 68e2a15b-d3af-4041-a441-2e5c63c1c9b6 as bootable. {{(pid=81996) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Copying metadata from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 to 68e2a15b-d3af-4041-a441-2e5c63c1c9b6. {{(pid=81996) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Creating volume glance metadata for volume 68e2a15b-d3af-4041-a441-2e5c63c1c9b6 backed by image cc5467f8-7dfc-439a-a775-b07f14ef45d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81996) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996eca88-d0ce-41ed-a05f-79756b509113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e423bfb-3cf2-4c3e-bde7-5776124890d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:14 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Volume volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 (68e2a15b-d3af-4041-a441-2e5c63c1c9b6): created successfully Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e423bfb-3cf2-4c3e-bde7-5776124890d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Flow 'volume_create_manager' (71017da0-7603-4a5b-82ce-6d8401393c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-fe789055-6099-441c-9e31-4bb6557d7d1b tempest-VolumesImageMetadata-1419534999 None] Created volume successfully. Apr 17 15:54:14 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9" returned: 0 in 1.206s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] <== create_volume: return (2766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.769s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba18c52-aef1-43b2-a860-3fe99936ab72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a12f0b-2957-4d40-8f49-caa4db786b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:14 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Volume volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 (b0cd3a95-9404-42c8-b31b-238ebab9eef9): created successfully Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a12f0b-2957-4d40-8f49-caa4db786b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Flow 'volume_create_manager' (0c23689b-9303-427f-9bbd-728ff2f9de6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-10943ecc-7189-4ff6-9a32-8eb316f60d35 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Created volume successfully. Apr 17 15:54:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Acquiring lock "cinder-68e2a15b-d3af-4041-a441-2e5c63c1c9b6-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Lock "cinder-68e2a15b-d3af-4041-a441-2e5c63c1c9b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Acquiring lock "cinder-quobyte-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Lock "cinder-quobyte-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf401740-21b5-49fe-bc07-12f97010924f]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:16 devstack sudo[84289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 Apr 17 15:54:16 devstack sudo[84289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:17 devstack sudo[84289]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" returned: 0 in 1.284s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:17 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 Apr 17 15:54:17 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-f75e7e13-6eea-4739-a5ae-febf943147ba tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-f75e7e13-6eea-4739-a5ae-febf943147ba tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc32da10-a3d9-4f71-806c-032135f79dcc]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-f75e7e13-6eea-4739-a5ae-febf943147ba tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:18 devstack sudo[84305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 Apr 17 15:54:18 devstack sudo[84305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:18 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" returned: 1 in 1.207s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:54:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:18 devstack sudo[84309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6 Apr 17 15:54:18 devstack sudo[84309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:19 devstack sudo[84305]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-f75e7e13-6eea-4739-a5ae-febf943147ba tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9" returned: 0 in 1.397s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-f75e7e13-6eea-4739-a5ae-febf943147ba tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.421s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-f75e7e13-6eea-4739-a5ae-febf943147ba tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc', 'name': 'volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7816382f-0fc2-4813-b311-54f7ae6c25f8', 'enforce_multipath': True} {{(pid=81996) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 17 15:54:20 devstack sudo[84309]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" returned: 0 in 1.263s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Lock "cinder-quobyte-68e2a15b-d3af-4041-a441-2e5c63c1c9b6" released by "delete_volume" :: held 3.918s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-f0c55dba-e9db-433f-a324-dc5b6e6b6758 req-f75e7e13-6eea-4739-a5ae-febf943147ba tempest-ServerBootFromVolumeStableRescueTest-434083933 None] attachment_update completed successfully. Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Created reservations ['f4783eb5-d37c-44fb-9d19-9bf17313143a', '2bf3b63f-b69c-49d9-8944-6d3a8e5f7758', '2fbc81fb-7b95-46e2-aac8-486a82d2aeb6', 'b789ea45-688b-442c-95fc-44b5c4134344'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:20 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:20 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:21 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.150s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:21 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Deleted volume successfully. Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c369e44a-bae7-4a4c-a308-e90ac6f04d2a tempest-VolumesImageMetadata-1419534999 None] Lock "cinder-68e2a15b-d3af-4041-a441-2e5c63c1c9b6-delete_volume" released by "delete_volume" :: held 5.476s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Flow 'volume_create_manager' (c6a6b5ab-e051-4bdd-beb2-2441cf9cc813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0af0984-135c-43ef-bdb1-b562a0acee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0af0984-135c-43ef-bdb1-b562a0acee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-875330554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17edb79-1d92-410a-852a-9141ee5babaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d67ec3350a4e0fb039cb43b916a08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:21Z,use_quota=True,user_id='dc2e7fd363334dec898649adbf579f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763ad1c3-ab67-450a-a704-3a428760ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763ad1c3-ab67-450a-a704-3a428760ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd78c1c-09c6-4ab5-93d5-dbb5e681cc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd78c1c-09c6-4ab5-93d5-dbb5e681cc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17edb79-1d92-410a-852a-9141ee5babaa', 'volume_name': 'volume-b17edb79-1d92-410a-852a-9141ee5babaa', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d402a4c-a260-4918-97d5-44ff33ef1f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d402a4c-a260-4918-97d5-44ff33ef1f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a5912-3b4c-4039-b9fa-56f6467f846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:21 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Volume b17edb79-1d92-410a-852a-9141ee5babaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17edb79-1d92-410a-852a-9141ee5babaa', 'volume_size': 1} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-875330554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17edb79-1d92-410a-852a-9141ee5babaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d67ec3350a4e0fb039cb43b916a08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:21Z,use_quota=True,user_id='dc2e7fd363334dec898649adbf579f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Creating volume b17edb79-1d92-410a-852a-9141ee5babaa {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:21 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:21 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa 1073741824 Apr 17 15:54:21 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Acquiring lock "cinder-70c729eb-32f7-4031-ae58-6ecb10cb5538-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "cinder-70c729eb-32f7-4031-ae58-6ecb10cb5538-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Acquiring lock "cinder-quobyte-70c729eb-32f7-4031-ae58-6ecb10cb5538" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "cinder-quobyte-70c729eb-32f7-4031-ae58-6ecb10cb5538" acquired by "delete_volume" :: waited 0.042s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:22 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6134db-dd7a-4e98-af72-8f7784332b5c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:22 devstack sudo[84473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 Apr 17 15:54:22 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:23 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538" returned: 0 in 0.705s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:23 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa 1073741824" returned: 0 in 1.711s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:23 devstack sudo[84481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538 Apr 17 15:54:23 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:23 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa Apr 17 15:54:23 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:24 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-70c729eb-32f7-4031-ae58-6ecb10cb5538" returned: 0 in 0.937s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "cinder-quobyte-70c729eb-32f7-4031-ae58-6ecb10cb5538" released by "delete_volume" :: held 1.738s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Created reservations ['8f6baeab-05a4-40a6-8c12-6d112fa0a0bb', 'd4d6f317-298a-4a6c-ae47-235ef2c51615', 'a773a8db-dd50-4caf-b517-5af0f953a707', '3aa00eec-b283-44d0-849a-4b8527310e68'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:24 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa" returned: 0 in 1.275s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] <== create_volume: return (3036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.043s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:24 devstack sudo[84495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:24 devstack sudo[84495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a5912-3b4c-4039-b9fa-56f6467f846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17edb79-1d92-410a-852a-9141ee5babaa', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1688e36c-e56a-4a4e-b8e8-d80ed6505ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:24 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Volume volume-b17edb79-1d92-410a-852a-9141ee5babaa (b17edb79-1d92-410a-852a-9141ee5babaa): created successfully Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1688e36c-e56a-4a4e-b8e8-d80ed6505ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Flow 'volume_create_manager' (c6a6b5ab-e051-4bdd-beb2-2441cf9cc813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-278814b8-f1b8-4a44-a0a8-bec2183e5647 tempest-VolumesMetadataTest-1966165974 None] Created volume successfully. Apr 17 15:54:25 devstack sudo[84495]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.015s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:25 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:25 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Deleted volume successfully. Apr 17 15:54:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5b7bcd45-556c-43a2-b05e-41b466fd0405 tempest-ServerRescueNegativeTestJSON-386995723 None] Lock "cinder-70c729eb-32f7-4031-ae58-6ecb10cb5538-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Flow 'volume_create_manager' (ff98cff0-6ea3-4844-a18d-57973244811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9f6ea3-f03e-4af3-b292-2e437af18b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9f6ea3-f03e-4af3-b292-2e437af18b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1108545483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c866eac-8257-47b4-a664-7147396eab1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c42d522dbe45d0ada0cf0ff2e25c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:26Z,use_quota=True,user_id='4e5b1589efbe49eaa2b7e887ece87460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02fa63e-efdf-465a-8e35-deb4007ee226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02fa63e-efdf-465a-8e35-deb4007ee226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e27825f-672d-4dc1-8d8c-4a350f202146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e27825f-672d-4dc1-8d8c-4a350f202146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c866eac-8257-47b4-a664-7147396eab1e', 'volume_name': 'volume-7c866eac-8257-47b4-a664-7147396eab1e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a851b4-6e33-43b4-b468-3c188603fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a851b4-6e33-43b4-b468-3c188603fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac78e3-b1f3-42a3-bd90-84822787affd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:26 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Volume 7c866eac-8257-47b4-a664-7147396eab1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c866eac-8257-47b4-a664-7147396eab1e', 'volume_size': 1} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1108545483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c866eac-8257-47b4-a664-7147396eab1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c42d522dbe45d0ada0cf0ff2e25c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:26Z,use_quota=True,user_id='4e5b1589efbe49eaa2b7e887ece87460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Creating volume 7c866eac-8257-47b4-a664-7147396eab1e {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:26 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:26 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e 1073741824 Apr 17 15:54:26 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Acquiring lock "cinder-b17edb79-1d92-410a-852a-9141ee5babaa-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Lock "cinder-b17edb79-1d92-410a-852a-9141ee5babaa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Acquiring lock "cinder-quobyte-b17edb79-1d92-410a-852a-9141ee5babaa" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Lock "cinder-quobyte-b17edb79-1d92-410a-852a-9141ee5babaa" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbf75d3-fdd2-4b5c-bcc8-f28aa0624acb]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:27 devstack sudo[84867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa Apr 17 15:54:27 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:27 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e 1073741824" returned: 0 in 1.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:27 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e Apr 17 15:54:27 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:28 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e" returned: 0 in 0.690s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac78e3-b1f3-42a3-bd90-84822787affd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c866eac-8257-47b4-a664-7147396eab1e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6043cf05-2783-4abb-aba0-66f261bc0fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:28 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Volume volume-7c866eac-8257-47b4-a664-7147396eab1e (7c866eac-8257-47b4-a664-7147396eab1e): created successfully Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6043cf05-2783-4abb-aba0-66f261bc0fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Flow 'volume_create_manager' (ff98cff0-6ea3-4844-a18d-57973244811c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:28 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-99e897f7-8c89-4034-b6f0-84181e6ab81c tempest-AbsoluteLimitsTests-1621990838 None] Created volume successfully. Apr 17 15:54:28 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa" returned: 0 in 1.049s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:28 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa Apr 17 15:54:28 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:29 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b17edb79-1d92-410a-852a-9141ee5babaa" returned: 0 in 0.443s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Lock "cinder-quobyte-b17edb79-1d92-410a-852a-9141ee5babaa" released by "delete_volume" :: held 1.517s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Created reservations ['9c79f843-e6eb-4d0f-bb50-2ced9c9dd049', '1c4b4fe2-b9c2-499a-894e-c075940b0d15', '43bc4341-91f6-42db-ac2f-ce97d3e7caa8', '305f866f-9c43-449e-b51f-e33084c332bb'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:29 devstack sudo[84882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:29 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Acquiring lock "cinder-7c866eac-8257-47b4-a664-7147396eab1e-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Lock "cinder-7c866eac-8257-47b4-a664-7147396eab1e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Acquiring lock "cinder-quobyte-7c866eac-8257-47b4-a664-7147396eab1e" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Lock "cinder-quobyte-7c866eac-8257-47b4-a664-7147396eab1e" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac88442-3961-4150-a2b1-dc2a1fe9bc9a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:29 devstack sudo[84884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e Apr 17 15:54:29 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:29 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.628s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Deleted volume successfully. Apr 17 15:54:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d0577368-8528-4a86-a838-ac40bc695198 tempest-VolumesMetadataTest-1966165974 None] Lock "cinder-b17edb79-1d92-410a-852a-9141ee5babaa-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:30 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e" returned: 0 in 0.655s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:30 devstack sudo[84890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e Apr 17 15:54:30 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:30 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c866eac-8257-47b4-a664-7147396eab1e" returned: 0 in 0.794s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Lock "cinder-quobyte-7c866eac-8257-47b4-a664-7147396eab1e" released by "delete_volume" :: held 1.514s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Created reservations ['f912b3c6-d04b-4a7e-a471-f83bdbaed752', '3c632ca0-85b0-4d2f-96c4-689df7f0a2a6', '8682bec9-74b9-4150-b8b6-472166406d3a', '52df2e30-8ffd-458a-8b86-136a451866ef'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:31 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:31 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:31 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.509s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:31 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Deleted volume successfully. Apr 17 15:54:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6a0598ac-9906-42a1-96fd-0cc9954ccdd3 tempest-AbsoluteLimitsTests-1621990838 None] Lock "cinder-7c866eac-8257-47b4-a664-7147396eab1e-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:54:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:34 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:34 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:35 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.669s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:35 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Flow 'volume_create_manager' (536f2723-5574-42d2-b3ec-606855bd03c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624b9d2a-1b15-4394-be9d-07f9db4e7f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624b9d2a-1b15-4394-be9d-07f9db4e7f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1931109709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a84b6d1cd7248f3a3c1f490ab044c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:37Z,use_quota=True,user_id='ba0f4bb2669d4d0c84e749ce3e6c740f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1653ed94-17d8-4d39-8486-e348ab495689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1653ed94-17d8-4d39-8486-e348ab495689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c17d9ee-66e2-4d98-857c-65ea53f0bc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c17d9ee-66e2-4d98-857c-65ea53f0bc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2', 'volume_name': 'volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8cb6e4-1e9d-461e-a149-d5164f88fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8cb6e4-1e9d-461e-a149-d5164f88fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa4295a-2256-4f4e-b52a-dadc27d6f347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:36 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Volume c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2', 'volume_size': 1} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1931109709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a84b6d1cd7248f3a3c1f490ab044c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:37Z,use_quota=True,user_id='ba0f4bb2669d4d0c84e749ce3e6c740f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Creating volume c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:36 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:36 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 1073741824 Apr 17 15:54:36 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:37 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 1073741824" returned: 0 in 0.546s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:37 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 Apr 17 15:54:37 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:37 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2" returned: 0 in 0.507s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa4295a-2256-4f4e-b52a-dadc27d6f347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7faeb57-ee14-4755-98e3-f50c316208ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:37 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Volume volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 (c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2): created successfully Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7faeb57-ee14-4755-98e3-f50c316208ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Flow 'volume_create_manager' (536f2723-5574-42d2-b3ec-606855bd03c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:37 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-90cfe9ac-dbe0-4932-a1a8-14d0feb438da tempest-VolumesTransfersTest-953299160 None] Created volume successfully. Apr 17 15:54:39 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-38231fe9-85a8-4c56-ba73-53b636e5912a tempest-VolumesTransfersTest-1881536930 None] Transfer volume completed successfully. Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Acquiring lock "cinder-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Lock "cinder-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=78,cinder:INSERT=30,cinder:UPDATE=97,cinder:DELETE=11 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Acquiring lock "cinder-quobyte-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Lock "cinder-quobyte-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2" acquired by "delete_volume" :: waited 0.020s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea548f1-de97-4802-b95c-bf2ae57b2e32]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:40 devstack sudo[84994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 Apr 17 15:54:40 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Flow 'volume_create_manager' (0cb0bbbc-e615-4006-a585-0885a587ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db3a11e-6357-402f-8e69-f66c97374bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db3a11e-6357-402f-8e69-f66c97374bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1636808772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70647ee-9ad9-48c6-9443-1fd43c4b79d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceef84af56a74bf68ed0d9a9d7fcf030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:40Z,use_quota=True,user_id='95199943451944349a4d430b70d5bdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652ddc54-9d98-41fc-a5a8-5f1bd789d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652ddc54-9d98-41fc-a5a8-5f1bd789d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78b0bda-4166-4210-95ab-5470f21e81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78b0bda-4166-4210-95ab-5470f21e81b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70647ee-9ad9-48c6-9443-1fd43c4b79d3', 'volume_name': 'volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918dcc82-62da-461e-9cff-6ca526ca6bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918dcc82-62da-461e-9cff-6ca526ca6bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b24d3fa-f9a4-407f-ad5a-9d10d2b684c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:40 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Volume c70647ee-9ad9-48c6-9443-1fd43c4b79d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3', 'volume_size': 1} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1636808772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70647ee-9ad9-48c6-9443-1fd43c4b79d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceef84af56a74bf68ed0d9a9d7fcf030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:40Z,use_quota=True,user_id='95199943451944349a4d430b70d5bdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Creating volume c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:40 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:40 devstack sudo[84996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 1073741824 Apr 17 15:54:40 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:40 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2" returned: 0 in 0.707s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:41 devstack sudo[85023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2 Apr 17 15:54:41 devstack sudo[85023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:41 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 1073741824" returned: 0 in 0.933s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:41 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:UPDATE=95,cinder:INSERT=25,cinder:SELECT=69,cinder:DELETE=7 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:54:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:41 devstack sudo[85033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:54:41 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:41 devstack sudo[85023]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2" returned: 0 in 0.889s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Lock "cinder-quobyte-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2" released by "delete_volume" :: held 1.636s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:41 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Created reservations ['5deb6f15-4de9-4a3a-b2ac-c833a36066d3', '66b726cc-157d-4bd8-9d32-7346b9b10ee9', '3983a874-1327-4727-a064-991577bdf481', '2228e08f-b97f-4a21-9d5a-bd7407bdee2f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:42 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:42 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:42 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 1.212s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b24d3fa-f9a4-407f-ad5a-9d10d2b684c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c0ae94-c4e2-44a6-a4fd-71032a15d76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:42 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Volume volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 (c70647ee-9ad9-48c6-9443-1fd43c4b79d3): created successfully Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c0ae94-c4e2-44a6-a4fd-71032a15d76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Flow 'volume_create_manager' (0cb0bbbc-e615-4006-a585-0885a587ab67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:42 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-01526155-c28a-430b-8349-fde5110733f2 tempest-VolumesActionsTest-860626120 None] Created volume successfully. Apr 17 15:54:42 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.781s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:42 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Deleted volume successfully. Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ac60fef9-bba7-4d0d-9686-14b281158e3d tempest-VolumesTransfersTest-658890967 None] Lock "cinder-c77ebe19-f978-40a4-b7b2-b4c9ac0da1e2-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Flow 'volume_create_manager' (68c18b7a-3957-4750-b6cc-843e5f88a064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044cf627-eaf3-4690-aa6b-d8f7fc70512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044cf627-eaf3-4690-aa6b-d8f7fc70512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1649959276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4b4418-bf5c-4b19-a8a5-973076b8bb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a84b6d1cd7248f3a3c1f490ab044c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:43Z,use_quota=True,user_id='ba0f4bb2669d4d0c84e749ce3e6c740f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed83a3b-c22b-4a93-b722-ce7cddf37540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed83a3b-c22b-4a93-b722-ce7cddf37540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ed8429-ffdb-46a3-bd8a-3d10362530ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ed8429-ffdb-46a3-bd8a-3d10362530ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4b4418-bf5c-4b19-a8a5-973076b8bb46', 'volume_name': 'volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1f437b-c989-4efc-ac1d-51faf27f6f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1f437b-c989-4efc-ac1d-51faf27f6f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be48da2-c2bb-442b-b041-7acf15b9771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:43 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Volume 9f4b4418-bf5c-4b19-a8a5-973076b8bb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46', 'volume_size': 1} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1649959276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4b4418-bf5c-4b19-a8a5-973076b8bb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a84b6d1cd7248f3a3c1f490ab044c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:43Z,use_quota=True,user_id='ba0f4bb2669d4d0c84e749ce3e6c740f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Creating volume 9f4b4418-bf5c-4b19-a8a5-973076b8bb46 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:43 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:43 devstack sudo[85065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 1073741824 Apr 17 15:54:43 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:43 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 1073741824" returned: 0 in 0.779s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:43 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 Apr 17 15:54:43 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:44 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be48da2-c2bb-442b-b041-7acf15b9771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272bf0e5-f5ab-4005-a3ab-27622a3fea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:44 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Volume volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 (9f4b4418-bf5c-4b19-a8a5-973076b8bb46): created successfully Apr 17 15:54:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272bf0e5-f5ab-4005-a3ab-27622a3fea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Flow 'volume_create_manager' (68c18b7a-3957-4750-b6cc-843e5f88a064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:44 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-dc42dfd9-261a-4600-9992-eecf7e885873 tempest-VolumesTransfersTest-953299160 None] Created volume successfully. Apr 17 15:54:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Acquiring lock "cinder-9f4b4418-bf5c-4b19-a8a5-973076b8bb46-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Lock "cinder-9f4b4418-bf5c-4b19-a8a5-973076b8bb46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Acquiring lock "cinder-quobyte-9f4b4418-bf5c-4b19-a8a5-973076b8bb46" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Lock "cinder-quobyte-9f4b4418-bf5c-4b19-a8a5-973076b8bb46" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:45 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e5c8e-bb92-4278-ba00-037192a3d7ac]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:45 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 Apr 17 15:54:45 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:46 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46" returned: 0 in 0.595s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:46 devstack sudo[85098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46 Apr 17 15:54:46 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:46 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9f4b4418-bf5c-4b19-a8a5-973076b8bb46" returned: 0 in 0.531s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Lock "cinder-quobyte-9f4b4418-bf5c-4b19-a8a5-973076b8bb46" released by "delete_volume" :: held 1.152s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Created reservations ['9b043518-80ee-4ed4-882c-d26bf0f7aca2', 'd16eac7e-0da4-47d4-ba1d-ef5a6ca98a04', '5a6b49ac-3723-4393-b247-51a3a9cc1ac4', '1231f0e3-526c-493c-ba06-106e29cd6cdd'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:46 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:46 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:47 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.556s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:47 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:47 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Deleted volume successfully. Apr 17 15:54:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9709f434-3507-4585-9086-faefad8ba7c7 tempest-VolumesTransfersTest-658890967 None] Lock "cinder-9f4b4418-bf5c-4b19-a8a5-973076b8bb46-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Flow 'volume_create_manager' (f4d94acc-e79b-4ef4-a224-0c4802d0a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a27e685-5743-4914-b7cf-36319a38ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a27e685-5743-4914-b7cf-36319a38ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-899333822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a948cf20-eff1-407d-872b-ed492d96a7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39985c605134bd88ed3cf1a1850935e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:54Z,use_quota=True,user_id='9523970224b34da0981c5a01df78a47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac94887a-cd59-42bc-ab65-96cec9d26542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac94887a-cd59-42bc-ab65-96cec9d26542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5534d7-a5ea-4370-8e6f-9e6d808f69b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5534d7-a5ea-4370-8e6f-9e6d808f69b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a948cf20-eff1-407d-872b-ed492d96a7f3', 'volume_name': 'volume-a948cf20-eff1-407d-872b-ed492d96a7f3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435e61e7-4dd8-4521-a371-39c6ed07cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435e61e7-4dd8-4521-a371-39c6ed07cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c78705-10c2-48d3-9192-154dfa23bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:54 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Volume a948cf20-eff1-407d-872b-ed492d96a7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a948cf20-eff1-407d-872b-ed492d96a7f3', 'volume_size': 1} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-899333822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a948cf20-eff1-407d-872b-ed492d96a7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39985c605134bd88ed3cf1a1850935e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:54:54Z,use_quota=True,user_id='9523970224b34da0981c5a01df78a47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Creating volume a948cf20-eff1-407d-872b-ed492d96a7f3 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:54:54 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:54:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:54 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 1073741824 Apr 17 15:54:54 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:55 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 1073741824" returned: 0 in 0.772s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:55 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 Apr 17 15:54:55 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:55 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3" returned: 0 in 0.545s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c78705-10c2-48d3-9192-154dfa23bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a948cf20-eff1-407d-872b-ed492d96a7f3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081b21f7-cc96-4874-ab54-d800398ca182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:54:55 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Volume volume-a948cf20-eff1-407d-872b-ed492d96a7f3 (a948cf20-eff1-407d-872b-ed492d96a7f3): created successfully Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081b21f7-cc96-4874-ab54-d800398ca182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:54:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Flow 'volume_create_manager' (f4d94acc-e79b-4ef4-a224-0c4802d0a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:54:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b7566d85-5b54-4f2d-b7ee-8313a0785a75 tempest-VolumesTransfersV357Test-1685703619 None] Created volume successfully. Apr 17 15:54:56 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a15e0e04-af35-48b2-bdcd-5609ebeafdea tempest-VolumesTransfersV357Test-1117791543 None] Transfer volume completed successfully. Apr 17 15:54:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Acquiring lock "cinder-a948cf20-eff1-407d-872b-ed492d96a7f3-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-a948cf20-eff1-407d-872b-ed492d96a7f3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Acquiring lock "cinder-quobyte-a948cf20-eff1-407d-872b-ed492d96a7f3" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:54:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-quobyte-a948cf20-eff1-407d-872b-ed492d96a7f3" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:54:57 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1986db93-c25b-4378-8ecb-3250ce79deae]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:54:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:57 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 Apr 17 15:54:57 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:58 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3" returned: 0 in 0.577s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:58 devstack sudo[85272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3 Apr 17 15:54:58 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:58 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a948cf20-eff1-407d-872b-ed492d96a7f3" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-quobyte-a948cf20-eff1-407d-872b-ed492d96a7f3" released by "delete_volume" :: held 1.142s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Created reservations ['fd9b8857-5f67-4430-98f9-a7fcd4876084', 'f5c231e3-a786-4f7b-a7c7-365e6917174e', '5ffe4e98-6db9-4bb3-83d1-8d3227f5164a', '483d2c93-7723-4780-9f9d-87aa44ee9412'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:54:59 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:54:59 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:54:59 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:54:59 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Deleted volume successfully. Apr 17 15:54:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7f21e33d-1f2f-4d98-a417-aae907429317 tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-a948cf20-eff1-407d-872b-ed492d96a7f3-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Flow 'volume_create_manager' (e0731887-1317-4b66-8233-a59fcb829676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80907ac3-f701-4dcc-84f5-3122e2a9ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80907ac3-f701-4dcc-84f5-3122e2a9ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2081735067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db9f9b-6887-4693-b4a9-45724c3acda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39985c605134bd88ed3cf1a1850935e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:00Z,use_quota=True,user_id='9523970224b34da0981c5a01df78a47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eda0401-7cea-427a-ba69-0824772a87cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eda0401-7cea-427a-ba69-0824772a87cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f41ddc0-49b6-4a49-a93a-45868383c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f41ddc0-49b6-4a49-a93a-45868383c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9db9f9b-6887-4693-b4a9-45724c3acda4', 'volume_name': 'volume-f9db9f9b-6887-4693-b4a9-45724c3acda4', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9d6b7c-cc1f-4f1d-b624-d2c1b39e494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9d6b7c-cc1f-4f1d-b624-d2c1b39e494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c173750e-9fed-496f-b702-a0b3440fc786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Volume f9db9f9b-6887-4693-b4a9-45724c3acda4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9db9f9b-6887-4693-b4a9-45724c3acda4', 'volume_size': 1} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2081735067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db9f9b-6887-4693-b4a9-45724c3acda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39985c605134bd88ed3cf1a1850935e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:00Z,use_quota=True,user_id='9523970224b34da0981c5a01df78a47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Creating volume f9db9f9b-6887-4693-b4a9-45724c3acda4 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:55:00 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:00 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 1073741824 Apr 17 15:55:00 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:00 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 1073741824" returned: 0 in 0.545s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:00 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 Apr 17 15:55:00 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:01 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4" returned: 0 in 0.566s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:55:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c173750e-9fed-496f-b702-a0b3440fc786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9db9f9b-6887-4693-b4a9-45724c3acda4', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71c00d-790d-4f75-a83c-5b66bcc1b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Volume volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 (f9db9f9b-6887-4693-b4a9-45724c3acda4): created successfully Apr 17 15:55:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71c00d-790d-4f75-a83c-5b66bcc1b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Flow 'volume_create_manager' (e0731887-1317-4b66-8233-a59fcb829676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:01 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2e577636-4a84-4684-bd22-de9c3a02de60 tempest-VolumesTransfersV357Test-1685703619 None] Created volume successfully. Apr 17 15:55:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Acquiring lock "cinder-f9db9f9b-6887-4693-b4a9-45724c3acda4-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-f9db9f9b-6887-4693-b4a9-45724c3acda4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Acquiring lock "cinder-quobyte-f9db9f9b-6887-4693-b4a9-45724c3acda4" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-quobyte-f9db9f9b-6887-4693-b4a9-45724c3acda4" acquired by "delete_volume" :: waited 0.036s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f9d42-e7cb-4f9d-acb5-71d49a860354]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:03 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 Apr 17 15:55:03 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:04 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4" returned: 0 in 1.053s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:04 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4 Apr 17 15:55:04 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8f685a2e-b412-4f03-8f09-3ad472aee1a9 tempest-VolumesActionsTest-860626120 None] Acquiring lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" by "attach_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8f685a2e-b412-4f03-8f09-3ad472aee1a9 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" acquired by "attach_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:04 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8f685a2e-b412-4f03-8f09-3ad472aee1a9 tempest-VolumesActionsTest-860626120 None] Attaching volume c70647ee-9ad9-48c6-9443-1fd43c4b79d3 to instance 85c8d547-e5d6-4ca1-87dd-0b0b2de0c587 at mountpoint /dev/vdb on host None. Apr 17 15:55:04 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8f685a2e-b412-4f03-8f09-3ad472aee1a9 tempest-VolumesActionsTest-860626120 None] Attach volume completed successfully. Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8f685a2e-b412-4f03-8f09-3ad472aee1a9 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" released by "attach_volume" :: held 0.071s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:04 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f9db9f9b-6887-4693-b4a9-45724c3acda4" returned: 0 in 0.530s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-quobyte-f9db9f9b-6887-4693-b4a9-45724c3acda4" released by "delete_volume" :: held 1.651s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:04 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Created reservations ['69c60104-aa2c-4ab7-a070-633686054fac', '94bc4014-f244-4ae3-b074-e8f3797a2356', 'c717b380-1d22-42ec-8809-0bbe82ee55b7', '482650ca-693e-43b3-8da2-aca0bd6ca0fc'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:05 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:55:05 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-805b6f6c-bc26-42b5-a41d-ff56b5f40fa5 tempest-VolumesActionsTest-860626120 None] Acquiring lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-detach_volume" by "detach_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-805b6f6c-bc26-42b5-a41d-ff56b5f40fa5 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-805b6f6c-bc26-42b5-a41d-ff56b5f40fa5 tempest-VolumesActionsTest-860626120 None] Detaching volume c70647ee-9ad9-48c6-9443-1fd43c4b79d3 from instance 85c8d547-e5d6-4ca1-87dd-0b0b2de0c587. Apr 17 15:55:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-805b6f6c-bc26-42b5-a41d-ff56b5f40fa5 tempest-VolumesActionsTest-860626120 None] Detach volume completed successfully. Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-805b6f6c-bc26-42b5-a41d-ff56b5f40fa5 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:05 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.536s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:55:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Deleted volume successfully. Apr 17 15:55:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89a4c4fb-18f8-4b23-94a6-f480086b38bb tempest-VolumesTransfersV357Test-68307984 None] Lock "cinder-f9db9f9b-6887-4693-b4a9-45724c3acda4-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:15 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=36,cinder:INSERT=15,cinder:UPDATE=41,cinder:DELETE=5 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:55:15 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=32,cinder:UPDATE=51,cinder:INSERT=7,cinder:DELETE=3 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Flow 'volume_create_manager' (bee70d50-1a80-4a29-a0bf-e9c8f1ddbd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e067fe3c-744a-4bcb-b273-0ee71633be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e067fe3c-744a-4bcb-b273-0ee71633be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b10f79-58e4-45b7-aaf5-e3a23e3b5b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1ef2791b2a48d1bd44343cb72225c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:25Z,use_quota=True,user_id='0ed1a57bec68414baa9267474dcfab33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac8c3c-16a2-40ee-bacf-8ce618564bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac8c3c-16a2-40ee-bacf-8ce618564bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46482486-bd9f-424d-830c-3cda6f56142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.image.glance [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Creating Keystone auth plugin from conf {{(pid=81996) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (79e0d15b-2629-478f-b884-43eb8456648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e553cea8-817a-4656-a76b-d164e9408506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e553cea8-817a-4656-a76b-d164e9408506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1692117339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e6fdf1-6da9-428b-b925-9ed37c82cf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:25Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b1099a-c9e6-4aae-bfd4-6b45fa621716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b1099a-c9e6-4aae-bfd4-6b45fa621716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6340f4e9-f097-44ac-ad8c-317e3343bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6340f4e9-f097-44ac-ad8c-317e3343bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e6fdf1-6da9-428b-b925-9ed37c82cf49', 'volume_name': 'volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a94209d-8528-4290-98c5-459437eca93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a94209d-8528-4290-98c5-459437eca93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bea9463-074c-43d6-9f82-37bb3ce02317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:25 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Volume 18e6fdf1-6da9-428b-b925-9ed37c82cf49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49', 'volume_size': 1} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1692117339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e6fdf1-6da9-428b-b925-9ed37c82cf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:25Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Creating volume 18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:55:25 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:25 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 1073741824 Apr 17 15:55:25 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46482486-bd9f-424d-830c-3cda6f56142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21b10f79-58e4-45b7-aaf5-e3a23e3b5b93', 'volume_name': 'volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a3feda-d930-42d1-80e2-ca8f804cebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a3feda-d930-42d1-80e2-ca8f804cebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4db9f8-8ccd-4942-8207-321df7e29461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:25 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Volume 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Trying to clone 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]). {{(pid=81996) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 15:55:25 devstack cinder-volume[81996]: INFO cinder.image.image_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Image download 20.69 MB at 20.69 MB/s Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ae74bf-4979-4e15-ac99-b9068332a87c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:25 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD Apr 17 15:55:25 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:26 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 1073741824" returned: 0 in 1.493s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:26 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:26 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 is fetched for user 0ed1a57bec68414baa9267474dcfab33. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 15:55:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:26 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 Apr 17 15:55:26 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dcf707-d44e-41cb-b238-fba4edf78559]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:26 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD Apr 17 15:55:26 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:27 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD" returned: 0 in 0.962s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:27 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49" returned: 0 in 1.153s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.735s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b10f79-58e4-45b7-aaf5-e3a23e3b5b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1ef2791b2a48d1bd44343cb72225c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:25Z,use_quota=True,user_id='0ed1a57bec68414baa9267474dcfab33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Creating volume 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:55:27 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bea9463-074c-43d6-9f82-37bb3ce02317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c582b8-e497-4f2a-b1db-67c24b65e2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:27 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 1073741824 Apr 17 15:55:27 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:27 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Volume volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 (18e6fdf1-6da9-428b-b925-9ed37c82cf49): created successfully Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c582b8-e497-4f2a-b1db-67c24b65e2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (79e0d15b-2629-478f-b884-43eb8456648f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:27 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-19d2e9cb-e365-4c15-8fa4-c7e20d69dcd9 tempest-VolumesSnapshotTestJSON-599023167 None] Created volume successfully. Apr 17 15:55:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:28 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 1073741824" returned: 0 in 0.942s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:28 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:55:28 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:29 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 0 in 0.529s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.768s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Creating offline snapshot 7bd09370-8076-4d9b-841d-fd51ae51f9cc of volume 18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[527642bf-ce4f-4c2c-978a-7cb292effdc8]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Attempting download of cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b6fd4d-31f9-449e-9a33-363ece7f4014]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_l108aeny {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:29 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 Apr 17 15:55:29 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:29 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_l108aeny Apr 17 15:55:29 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:30 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49" returned: 0 in 1.151s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:30 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc 1G Apr 17 15:55:30 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:30 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_l108aeny" returned: 0 in 1.162s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_l108aeny {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:30 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_l108aeny Apr 17 15:55:30 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:32 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_l108aeny" returned: 1 in 1.729s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_l108aeny' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:55:32 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca69b09-450c-45b1-be98-e7bee422cc8b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:32 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc 1G" returned: 0 in 1.870s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:32 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc Apr 17 15:55:32 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:32 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD Apr 17 15:55:32 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:33 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:33 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] cc5467f8-7dfc-439a-a775-b07f14ef45d1 was qcow2, converting to raw {{(pid=81996) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 15:55:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:33 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:55:33 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:33 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc" returned: 0 in 1.414s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:33 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc is being set with open permissions: ugo+rw Apr 17 15:55:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:33 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc Apr 17 15:55:33 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-79226ce8-763e-474d-b17f-aea7b2644e3f tempest-VolumesActionsTest-860626120 None] Acquiring lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" by "attach_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-79226ce8-763e-474d-b17f-aea7b2644e3f tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" acquired by "attach_volume" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-79226ce8-763e-474d-b17f-aea7b2644e3f tempest-VolumesActionsTest-860626120 None] Attaching volume c70647ee-9ad9-48c6-9443-1fd43c4b79d3 to instance 712688c3-d2b7-41d1-a0de-59ea24c26ea2 at mountpoint /dev/vdb on host None. Apr 17 15:55:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-79226ce8-763e-474d-b17f-aea7b2644e3f tempest-VolumesActionsTest-860626120 None] Attach volume completed successfully. Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-79226ce8-763e-474d-b17f-aea7b2644e3f tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" released by "attach_volume" :: held 0.110s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:34 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:55:34 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:34 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc" returned: 0 in 1.057s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:34 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.info Apr 17 15:55:34 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ed0e975-5670-45bf-bb92-6729ce71a522 tempest-VolumesActionsTest-860626120 None] Acquiring lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-detach_volume" by "detach_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ed0e975-5670-45bf-bb92-6729ce71a522 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4ed0e975-5670-45bf-bb92-6729ce71a522 tempest-VolumesActionsTest-860626120 None] Detaching volume c70647ee-9ad9-48c6-9443-1fd43c4b79d3 from instance 712688c3-d2b7-41d1-a0de-59ea24c26ea2. Apr 17 15:55:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4ed0e975-5670-45bf-bb92-6729ce71a522 tempest-VolumesActionsTest-860626120 None] Detach volume completed successfully. Apr 17 15:55:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ed0e975-5670-45bf-bb92-6729ce71a522 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-detach_volume" released by "detach_volume" :: held 0.184s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:35 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.219s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:35 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:55:35 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.info" returned: 0 in 0.908s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:35 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.info is being set with open permissions: ugo+rw Apr 17 15:55:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:35 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.info Apr 17 15:55:35 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:36 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.info" returned: 0 in 0.687s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.259s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-32070dbb-2721-400f-831c-543081a82e83 tempest-VolumesSnapshotTestJSON-599023167 None] Create snapshot completed successfully Apr 17 15:55:37 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 0 in 4.001s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1__tf2lejqdevstack@QuobyteHD, size 112.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:55:37 devstack cinder-volume[81996]: INFO cinder.image.image_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Converted 112.00 MB image at 27.99 MB/s Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:37 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 1G Apr 17 15:55:37 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-7bd09370-8076-4d9b-841d-fd51ae51f9cc-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-7bd09370-8076-4d9b-841d-fd51ae51f9cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-18e6fdf1-6da9-428b-b925-9ed37c82cf49" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-18e6fdf1-6da9-428b-b925-9ed37c82cf49" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-7bd09370-8076-4d9b-841d-fd51ae51f9cc" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-7bd09370-8076-4d9b-841d-fd51ae51f9cc" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Deleting offline snapshot 7bd09370-8076-4d9b-841d-fd51ae51f9cc of volume 18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] snapshot_file for this snap is: volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f1bf5d-cf41-41d0-9944-1a52322b1764]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:38 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc Apr 17 15:55:38 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:38 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 1G" returned: 0 in 1.594s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:38 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a458ad9-8fac-487d-b2d6-cce00c34fc41]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:38 devstack sudo[86033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:55:38 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:39 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc" returned: 0 in 1.160s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[94205596-a73c-4217-ae1c-dc40d407f9f9]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:39 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 Apr 17 15:55:39 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:39 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 0 in 0.651s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:39 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:55:39 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:39 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49" returned: 0 in 0.726s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:39 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc Apr 17 15:55:39 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:40 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 1 in 0.927s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Downloaded image cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 successfully. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 for user 0ed1a57bec68414baa9267474dcfab33 is deleted. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Marking volume 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 as bootable. {{(pid=81996) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Copying metadata from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 to 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93. {{(pid=81996) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Creating volume glance metadata for volume 21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 backed by image cc5467f8-7dfc-439a-a775-b07f14ef45d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81996) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4db9f8-8ccd-4942-8207-321df7e29461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8cdad51-707b-4486-a332-442bd7e5a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:40 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Volume volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 (21b10f79-58e4-45b7-aaf5-e3a23e3b5b93): created successfully Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8cdad51-707b-4486-a332-442bd7e5a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Flow 'volume_create_manager' (bee70d50-1a80-4a29-a0bf-e9c8f1ddbd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:40 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:40 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-46be2ac7-abcb-47d5-bc0a-053662eef36e tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Created volume successfully. Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc" returned: 0 in 0.701s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:40 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc Apr 17 15:55:40 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:40 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49.7bd09370-8076-4d9b-841d-fd51ae51f9cc" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-7bd09370-8076-4d9b-841d-fd51ae51f9cc" released by "_delete_snapshot" :: held 3.250s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-18e6fdf1-6da9-428b-b925-9ed37c82cf49" released by "delete_snapshot" :: held 3.286s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:41 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['7c4a3465-0936-4f93-958d-6e9a13efd64c', '4f4b6fa2-8a6b-4951-ba93-3b9339b71674', 'e2184598-c969-4747-9537-34c8a35ccac5', '8107808d-7aeb-41ed-bcba-ec4dad1b46fe'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:55:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Delete snapshot completed successfully. Apr 17 15:55:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0583f17c-6f4d-49f9-a60e-94f0f114397e tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-7bd09370-8076-4d9b-841d-fd51ae51f9cc-delete_snapshot" released by "delete_snapshot" :: held 3.456s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (efd5fa3f-8c1f-47c8-bb81-ddde27fe3301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c655d5c-328a-4fcd-aa3f-83ce7c99b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c655d5c-328a-4fcd-aa3f-83ce7c99b77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-106442935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebff9d5-2b8c-4bb6-b2bb-c5735868de65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:42Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e51870-be11-4f20-8373-7ee29e4db211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e51870-be11-4f20-8373-7ee29e4db211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c45d82-8d7d-41e5-a6e2-64db1522cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c45d82-8d7d-41e5-a6e2-64db1522cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebff9d5-2b8c-4bb6-b2bb-c5735868de65', 'volume_name': 'volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bc2e28-fb8b-42ca-9174-41c4f80457ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bc2e28-fb8b-42ca-9174-41c4f80457ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce6622e-9186-42de-a8b8-6736f0e596ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:42 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Volume eebff9d5-2b8c-4bb6-b2bb-c5735868de65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65', 'volume_size': 1} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-106442935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebff9d5-2b8c-4bb6-b2bb-c5735868de65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:42Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Creating volume eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:55:42 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:42 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 1073741824 Apr 17 15:55:42 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Flow 'volume_create_manager' (7b0aebeb-f86e-4b59-be54-7b735b5fc3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5dcbe2-43ab-4131-9481-d2fba9360b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5dcbe2-43ab-4131-9481-d2fba9360b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-570755947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1b99f8-807e-45ce-9523-8c8e50edc206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb14e84afce4572af96675a6e9e971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:43Z,use_quota=True,user_id='9e6ece13193f457ebd65760044507e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0eb68b-38aa-4400-9acc-eac829750759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0eb68b-38aa-4400-9acc-eac829750759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d1ff02-f66d-4055-a7e2-15fa6bca8399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d1ff02-f66d-4055-a7e2-15fa6bca8399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1b99f8-807e-45ce-9523-8c8e50edc206', 'volume_name': 'volume-2e1b99f8-807e-45ce-9523-8c8e50edc206', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c013de73-8edf-461e-86f5-893b239fd7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c013de73-8edf-461e-86f5-893b239fd7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8f163e-6521-40be-af1e-263c441444c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:43 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Volume 2e1b99f8-807e-45ce-9523-8c8e50edc206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1b99f8-807e-45ce-9523-8c8e50edc206', 'volume_size': 1} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:43 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 1073741824" returned: 0 in 0.826s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:43 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 Apr 17 15:55:43 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:43 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" returned: 0 in 0.459s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-570755947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1b99f8-807e-45ce-9523-8c8e50edc206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb14e84afce4572af96675a6e9e971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:43Z,use_quota=True,user_id='9e6ece13193f457ebd65760044507e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Creating volume 2e1b99f8-807e-45ce-9523-8c8e50edc206 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:55:43 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce6622e-9186-42de-a8b8-6736f0e596ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db5b4bb-d11f-4034-a392-803c1240be9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:43 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 1073741824 Apr 17 15:55:43 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:43 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Volume volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 (eebff9d5-2b8c-4bb6-b2bb-c5735868de65): created successfully Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db5b4bb-d11f-4034-a392-803c1240be9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (efd5fa3f-8c1f-47c8-bb81-ddde27fe3301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-fdfd0a49-2730-421d-be8c-9067cca037d6 tempest-VolumesSnapshotTestJSON-599023167 None] Created volume successfully. Apr 17 15:55:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:44 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 1073741824" returned: 0 in 0.611s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:44 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 Apr 17 15:55:44 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:44 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206" returned: 0 in 0.547s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.987s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8f163e-6521-40be-af1e-263c441444c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1b99f8-807e-45ce-9523-8c8e50edc206', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4949eec8-bd97-40f6-97f5-932849147c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:44 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Volume volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 (2e1b99f8-807e-45ce-9523-8c8e50edc206): created successfully Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4949eec8-bd97-40f6-97f5-932849147c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Flow 'volume_create_manager' (7b0aebeb-f86e-4b59-be54-7b735b5fc3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c374d32c-05ab-4607-a7c1-cfbb693c8594]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:44 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3f511d68-19ed-42b2-8f3f-876c937ac0c5 tempest-ServersNegativeTestJSON-1271528051 None] Created volume successfully. Apr 17 15:55:44 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:55:44 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:45 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 0 in 0.540s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:45 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:55:45 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:45 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 1 in 0.510s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.112s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.331s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Creating offline snapshot 921e0855-1d44-4c78-9cd8-54951ecdcf3e of volume eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a5308c-0037-46bb-bcdf-44e367353ca2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc', 'name': 'volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d684258-91e6-4931-8d64-a21e0cb90ff6', 'enforce_multipath': True} {{(pid=81996) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 17 15:55:46 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 Apr 17 15:55:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-0b7b73e2-4ce6-45ab-89ef-9e91c7eef90f req-20eaaeb8-c72c-42e7-9557-38b77c30a059 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] attachment_update completed successfully. Apr 17 15:55:46 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:46 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" returned: 0 in 0.541s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:46 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e 1G Apr 17 15:55:46 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Flow 'volume_create_manager' (6cae6d9a-aa84-44ca-930d-1172bc8e363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df8cd3c-a4ef-4890-9a99-4ae50ad679f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df8cd3c-a4ef-4890-9a99-4ae50ad679f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-796801692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638dd1ea-563e-434d-b351-55f1ccb076bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb14e84afce4572af96675a6e9e971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:47Z,use_quota=True,user_id='9e6ece13193f457ebd65760044507e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1f0e83-aeab-45c8-a9c5-dd4a1ee01fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1f0e83-aeab-45c8-a9c5-dd4a1ee01fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a325290-8778-442a-965d-5114f57dfda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a325290-8778-442a-965d-5114f57dfda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '638dd1ea-563e-434d-b351-55f1ccb076bd', 'volume_name': 'volume-638dd1ea-563e-434d-b351-55f1ccb076bd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf55f6ae-d7d0-431a-9d2b-ebd24d7e2949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf55f6ae-d7d0-431a-9d2b-ebd24d7e2949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dd5952-18ef-441c-8710-590531247359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Volume 638dd1ea-563e-434d-b351-55f1ccb076bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-638dd1ea-563e-434d-b351-55f1ccb076bd', 'volume_size': 1} Apr 17 15:55:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:47 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e 1G" returned: 0 in 0.581s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:47 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e Apr 17 15:55:47 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:47 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:47 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e is being set with open permissions: ugo+rw Apr 17 15:55:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:47 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e Apr 17 15:55:47 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:48 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e" returned: 0 in 0.478s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:48 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.info Apr 17 15:55:48 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:48 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.info" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:48 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.info is being set with open permissions: ugo+rw Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:48 devstack sudo[86122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.info Apr 17 15:55:48 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:48 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.info" returned: 0 in 0.404s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.200s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcffa323-677f-4e77-bdd5-85533457f5af]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-aeb6c0e3-a55d-4f79-87ca-375c41856ba9 tempest-VolumesSnapshotTestJSON-599023167 None] Create snapshot completed successfully Apr 17 15:55:49 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:55:49 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:49 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.539s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:49 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceee50c-4769-4cbc-b89f-d15ab5e26e52]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:49 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:55:49 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:49 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.461s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.77402631-a8b6-4813-9900-e3fcffcbb64c6n7pht__.img {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:49 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.77402631-a8b6-4813-9900-e3fcffcbb64c6n7pht__.img Apr 17 15:55:49 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (25220dd5-9fae-4710-b551-f5c1c4d4c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b352b9cd-232a-4180-9c97-78ef88e6ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b352b9cd-232a-4180-9c97-78ef88e6ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-561143046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66660cb-5353-494d-8dab-703eb0db89c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=921e0855-1d44-4c78-9cd8-54951ecdcf3e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:50Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5ab93e-7f81-4f30-ae69-944443db1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5ab93e-7f81-4f30-ae69-944443db1be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2194fc-890c-4ae8-b6dc-d9918bbb60d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2194fc-890c-4ae8-b6dc-d9918bbb60d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f66660cb-5353-494d-8dab-703eb0db89c4', 'volume_name': 'volume-f66660cb-5353-494d-8dab-703eb0db89c4', 'volume_size': 2, 'snapshot_id': '921e0855-1d44-4c78-9cd8-54951ecdcf3e'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd3a3b-3f9d-4458-b70e-2b2d4e23e3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd3a3b-3f9d-4458-b70e-2b2d4e23e3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9147e973-5049-494f-b7b1-19fb2aab8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:55:50 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Volume f66660cb-5353-494d-8dab-703eb0db89c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f66660cb-5353-494d-8dab-703eb0db89c4', 'volume_size': 2, 'snapshot_id': '921e0855-1d44-4c78-9cd8-54951ecdcf3e'} Apr 17 15:55:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:55:53 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.77402631-a8b6-4813-9900-e3fcffcbb64c6n7pht__.img" returned: 0 in 3.609s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa34cea-f03a-4b49-a9f0-feee7c81df87]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:55:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:55:53 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:55:53 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:55:54 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Apr 17 15:55:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.698s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:55:54 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3, size 1024.00 MB, duration 3.61 sec, destination /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.77402631-a8b6-4813-9900-e3fcffcbb64c6n7pht__.img {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:55:54 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Converted 1024.00 MB image at 283.59 MB/s Apr 17 15:55:54 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] 77402631-a8b6-4813-9900-e3fcffcbb64c was raw, no need to convert to raw {{(pid=81996) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 17 15:56:04 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=50,cinder:INSERT=10,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:56:04 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=51,cinder:UPDATE=30,cinder:INSERT=15,cinder:DELETE=2 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.321s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Uploaded volume to glance image-id: 77402631-a8b6-4813-9900-e3fcffcbb64c. {{(pid=81996) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.611s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-796801692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638dd1ea-563e-434d-b351-55f1ccb076bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb14e84afce4572af96675a6e9e971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:55:47Z,use_quota=True,user_id='9e6ece13193f457ebd65760044507e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Creating volume 638dd1ea-563e-434d-b351-55f1ccb076bd {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:05 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:05 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd 1073741824 Apr 17 15:56:05 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6743c8a6-3e62-4605-aaca-bdd97bf03686 tempest-VolumesActionsTest-860626120 None] Copy volume to image completed successfully. Apr 17 15:56:06 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd 1073741824" returned: 0 in 0.884s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:06 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd Apr 17 15:56:06 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:06 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd" returned: 0 in 0.666s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 16.534s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-921e0855-1d44-4c78-9cd8-54951ecdcf3e-f66660cb-5353-494d-8dab-703eb0db89c4" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dd5952-18ef-441c-8710-590531247359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-638dd1ea-563e-434d-b351-55f1ccb076bd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fb2b3a-a3b6-4735-bbb1-3844be3d140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:06 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Volume volume-638dd1ea-563e-434d-b351-55f1ccb076bd (638dd1ea-563e-434d-b351-55f1ccb076bd): created successfully Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fb2b3a-a3b6-4735-bbb1-3844be3d140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Flow 'volume_create_manager' (6cae6d9a-aa84-44ca-930d-1172bc8e363e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-921e0855-1d44-4c78-9cd8-54951ecdcf3e-f66660cb-5353-494d-8dab-703eb0db89c4" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Creating volume f66660cb-5353-494d-8dab-703eb0db89c4 from snapshot 921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-f66660cb-5353-494d-8dab-703eb0db89c4" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:06 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e2d10e5b-1f97-4cd9-9979-3eb8bedf2ea9 tempest-ServersNegativeTestJSON-1271528051 None] Created volume successfully. Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-f66660cb-5353-494d-8dab-703eb0db89c4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] snapshot: 921e0855-1d44-4c78-9cd8-54951ecdcf3e, volume: f66660cb-5353-494d-8dab-703eb0db89c4, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb073e-0a84-4b82-bf08-39e73bd15fa6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:07 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e Apr 17 15:56:07 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "cinder-638dd1ea-563e-434d-b351-55f1ccb076bd-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-638dd1ea-563e-434d-b351-55f1ccb076bd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "cinder-quobyte-638dd1ea-563e-434d-b351-55f1ccb076bd" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-quobyte-638dd1ea-563e-434d-b351-55f1ccb076bd" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff32ab96-c9f7-4943-8b0a-2ed891f03342]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:07 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd Apr 17 15:56:07 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:07 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e" returned: 0 in 0.654s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d854ccf6-135b-4265-ab45-7295867f1581]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:07 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 Apr 17 15:56:07 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:08 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd" returned: 0 in 0.616s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:08 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd Apr 17 15:56:08 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:08 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" returned: 0 in 0.595s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:08 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 Apr 17 15:56:08 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:08 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-638dd1ea-563e-434d-b351-55f1ccb076bd" returned: 0 in 0.447s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-quobyte-638dd1ea-563e-434d-b351-55f1ccb076bd" released by "delete_volume" :: held 1.126s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Created reservations ['361be8bc-d973-4ff8-ac38-666ddce5ac2e', '15a85d33-7c17-4eee-8f50-96a64b657dd3', '96e659d3-e88a-4b29-8675-30dddf458508', 'f1d9c107-9fe9-4e8b-8a85-24c7f72bd2b2'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:08 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:08 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:09 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.000s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Deleted volume successfully. Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-264db667-c546-460b-837f-71ca22187477 tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-638dd1ea-563e-434d-b351-55f1ccb076bd-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "cinder-2e1b99f8-807e-45ce-9523-8c8e50edc206-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-2e1b99f8-807e-45ce-9523-8c8e50edc206-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "cinder-quobyte-2e1b99f8-807e-45ce-9523-8c8e50edc206" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-quobyte-2e1b99f8-807e-45ce-9523-8c8e50edc206" acquired by "delete_volume" :: waited 0.026s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b07ce6-62d6-485a-8de4-9ba3419a1d91]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:10 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 Apr 17 15:56:10 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:11 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4" returned: 0 in 3.182s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:11 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985f32a-9e58-421d-8b91-64b5e41d0236]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:11 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 Apr 17 15:56:11 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:11 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206" returned: 0 in 1.628s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:11 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206 Apr 17 15:56:11 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:12 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2e1b99f8-807e-45ce-9523-8c8e50edc206" returned: 0 in 0.611s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-quobyte-2e1b99f8-807e-45ce-9523-8c8e50edc206" released by "delete_volume" :: held 2.278s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:12 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" returned: 0 in 0.798s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65, size 1024.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:56:12 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Converted 1024.00 MB image at 321.55 MB/s Apr 17 15:56:12 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 is being set with open permissions: ugo+rw Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Created reservations ['b24b0c57-6a0b-4718-89dd-5a44281231f9', 'b13132b9-ab34-4207-adda-adbd936f782e', 'f5556b59-4275-447b-9875-ab0db82c2e41', '4f9a71b2-a3bb-4fe2-9382-9fbe25a8ec6f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:12 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 Apr 17 15:56:12 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:12 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:12 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:12 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4" returned: 0 in 0.567s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-f66660cb-5353-494d-8dab-703eb0db89c4" released by "_copy_volume_from_snapshot" :: held 5.914s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-921e0855-1d44-4c78-9cd8-54951ecdcf3e-f66660cb-5353-494d-8dab-703eb0db89c4" released by "_create_volume_from_snapshot" :: held 5.945s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.992s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.497s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea2fd01-d8ee-413f-82aa-c3dd8ac12ace]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9147e973-5049-494f-b7b1-19fb2aab8c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66660cb-5353-494d-8dab-703eb0db89c4', 'volume_size': 2, 'snapshot_id': '921e0855-1d44-4c78-9cd8-54951ecdcf3e'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d88174-c298-407e-a424-d4af528cf400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:12 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.621s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:12 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Volume volume-f66660cb-5353-494d-8dab-703eb0db89c4 (f66660cb-5353-494d-8dab-703eb0db89c4): created successfully Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d88174-c298-407e-a424-d4af528cf400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (25220dd5-9fae-4710-b551-f5c1c4d4c061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:13 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Deleted volume successfully. Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37b344a3-fab0-47b4-ae1a-d3c886aea2cb tempest-ServersNegativeTestJSON-1271528051 None] Lock "cinder-2e1b99f8-807e-45ce-9523-8c8e50edc206-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:13 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b3bf3e50-eecb-41ec-9411-7a258cad459b tempest-VolumesSnapshotTestJSON-599023167 None] Created volume successfully. Apr 17 15:56:13 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:56:13 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-f66660cb-5353-494d-8dab-703eb0db89c4-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-f66660cb-5353-494d-8dab-703eb0db89c4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-f66660cb-5353-494d-8dab-703eb0db89c4" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-f66660cb-5353-494d-8dab-703eb0db89c4" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3254ddd1-083d-4637-b65c-fe4983a32326]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:13 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.718s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e645e3b-4327-4417-954c-9ec97047eaf7]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:13 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 Apr 17 15:56:13 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:13 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:56:13 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:14 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4" returned: 0 in 0.591s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:14 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4 Apr 17 15:56:14 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:14 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.656s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:14 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img Apr 17 15:56:14 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:14 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f66660cb-5353-494d-8dab-703eb0db89c4" returned: 0 in 0.578s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-f66660cb-5353-494d-8dab-703eb0db89c4" released by "delete_volume" :: held 1.195s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['5e862134-c7a8-460a-8578-97ddef96eb98', 'ae23c84a-0f56-49c1-82df-0f1c8ec7dbbb', '4489a1bc-778a-421b-af02-a6fa4fac80f5', '70334ba1-25c0-4a74-911b-a0e7208b6841'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:15 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:15 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-921e0855-1d44-4c78-9cd8-54951ecdcf3e-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-921e0855-1d44-4c78-9cd8-54951ecdcf3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" acquired by "delete_snapshot" :: waited 0.062s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-921e0855-1d44-4c78-9cd8-54951ecdcf3e" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-921e0855-1d44-4c78-9cd8-54951ecdcf3e" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Deleting offline snapshot 921e0855-1d44-4c78-9cd8-54951ecdcf3e of volume eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] snapshot_file for this snap is: volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7946d1-8b19-4f84-827c-de8b37daa5ad]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:16 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e Apr 17 15:56:16 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:16 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.793s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:16 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Deleted volume successfully. Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9df36e5c-de96-407b-a7b0-cf8031bd45d9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-f66660cb-5353-494d-8dab-703eb0db89c4-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:16 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img" returned: 0 in 2.577s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32b3a95-4645-4164-befc-32e57de2a284]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:16 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:56:16 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:17 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e" returned: 0 in 0.852s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9442f05-309f-4c52-8de8-17f37282da8a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:17 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 Apr 17 15:56:17 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:17 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.704s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:56:17 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Converted 1024.00 MB image at 397.22 MB/s Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] d44a8345-fbb1-44d3-953c-2a2afa2d634a was raw, converting to qcow2 {{(pid=81996) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea98b0-08a3-4c07-94c7-fc3a88622a46]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:17 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img Apr 17 15:56:17 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:17 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" returned: 0 in 0.527s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:17 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e Apr 17 15:56:17 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-d24c75c1-d487-431d-83c6-84414b476ada req-18c6ecc3-def2-4b02-8255-6f800363f2e9 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Terminate volume connection completed successfully. Apr 17 15:56:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-d24c75c1-d487-431d-83c6-84414b476ada req-18c6ecc3-def2-4b02-8255-6f800363f2e9 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Deleting attachment 2d684258-91e6-4931-8d64-a21e0cb90ff6. {{(pid=81996) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 17 15:56:18 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img" returned: 0 in 0.515s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:18 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img Apr 17 15:56:18 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:18 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e" returned: 0 in 0.514s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:18 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e Apr 17 15:56:18 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "cinder-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "cinder-quobyte-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-quobyte-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad954b-486f-4428-aadd-00cc77e30acd]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:18 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:56:18 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:18 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img" returned: 1 in 0.539s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img /opt/stack/data/cinder/conversion/vol_upload_9n71yud5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:18 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img /opt/stack/data/cinder/conversion/vol_upload_9n71yud5 Apr 17 15:56:18 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:18 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65.921e0855-1d44-4c78-9cd8-54951ecdcf3e" returned: 0 in 0.520s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-921e0855-1d44-4c78-9cd8-54951ecdcf3e" released by "_delete_snapshot" :: held 2.508s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" released by "delete_snapshot" :: held 2.571s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['ae2157f0-ae43-432c-9a36-3f4b9fd7cd4c', '52f116cf-a53e-486d-a914-536c9317c2b5', '13b286a3-501e-43f7-a6ce-28196bdc05b2', '30ed5930-4c00-496d-a8cc-ab45c409eca9'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Delete snapshot completed successfully. Apr 17 15:56:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8d7ca5f6-c59b-4a82-ada1-ee6b618364f9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-921e0855-1d44-4c78-9cd8-54951ecdcf3e-delete_snapshot" released by "delete_snapshot" :: held 2.771s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:19 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 0 in 0.571s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:19 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img /opt/stack/data/cinder/conversion/vol_upload_9n71yud5" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Image conversion details: src /opt/stack/data/cinder/conversion/c70647ee-9ad9-48c6-9443-1fd43c4b79d3.temp_image.d44a8345-fbb1-44d3-953c-2a2afa2d634ak3rvyacd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9n71yud5 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:56:19 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94aec38-82d2-4adf-9be3-438b7f4c9a90]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9n71yud5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:19 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:56:19 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:19 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9n71yud5 Apr 17 15:56:19 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-eebff9d5-2b8c-4bb6-b2bb-c5735868de65-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-eebff9d5-2b8c-4bb6-b2bb-c5735868de65-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b211fd-90c5-4ce5-986b-3f7cd9f19d3c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:19 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 Apr 17 15:56:19 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:19 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 1 in 0.511s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:19 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93 Apr 17 15:56:19 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:19 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9n71yud5" returned: 0 in 0.567s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:20 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" returned: 0 in 0.626s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:20 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65 Apr 17 15:56:20 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:20 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" returned: 0 in 0.563s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-quobyte-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93" released by "delete_volume" :: held 1.686s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.quota [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Created reservations ['d9434bc6-6272-4c8b-a9df-d18e90771a09', '5dce900a-3374-4bce-bd8a-fa97813f72fa', 'c9578f13-3126-471a-9cc8-0d727c53d959', '207ad4b2-ef62-4a3d-993d-9efb6a092d11'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:20 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:20 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:20 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" returned: 0 in 0.559s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-eebff9d5-2b8c-4bb6-b2bb-c5735868de65" released by "delete_volume" :: held 1.224s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['6a82fd5e-628d-4eb3-9f71-2f646e0698b8', 'e78c14cd-3330-400c-89a3-7dcf15badb1a', '76743898-3dc2-4ddf-8e50-ceb6788379ee', '07e65403-7f23-4984-a3a9-56fbc4ec296f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:20 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:20 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.927s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Uploaded volume to glance image-id: d44a8345-fbb1-44d3-953c-2a2afa2d634a. {{(pid=81996) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 17 15:56:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-97f192aa-2ae1-4142-b1ef-8a8ec49ea967 tempest-VolumesActionsTest-860626120 None] Copy volume to image completed successfully. Apr 17 15:56:20 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.659s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.manager [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Deleted volume successfully. Apr 17 15:56:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-d24c75c1-d487-431d-83c6-84414b476ada req-61440dbc-94c6-4266-a2c7-a649024245c8 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-21b10f79-58e4-45b7-aaf5-e3a23e3b5b93-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:21 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.554s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:21 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Deleted volume successfully. Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cdb905b9-ffcc-4999-993f-cd1c1d96f947 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-eebff9d5-2b8c-4bb6-b2bb-c5735868de65-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Acquiring lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Acquiring lock "cinder-quobyte-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Lock "cinder-quobyte-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" acquired by "delete_volume" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7d15ef-3ad8-4a7f-9a73-7d3e38f33d9e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:21 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:56:21 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (0b383e32-527a-4744-a21e-9deca777e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b46f05-a740-4031-9ac6-59e56b648d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b46f05-a740-4031-9ac6-59e56b648d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903821404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba23422-b9a9-4843-9b3e-f103c882da6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:22Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40515518-576f-46d0-8428-9fd887486ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40515518-576f-46d0-8428-9fd887486ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c875fd3b-c5d8-46cc-b406-169099a275fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c875fd3b-c5d8-46cc-b406-169099a275fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba23422-b9a9-4843-9b3e-f103c882da6d', 'volume_name': 'volume-7ba23422-b9a9-4843-9b3e-f103c882da6d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0e4a6f-63f0-400d-adec-e859976034c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0e4a6f-63f0-400d-adec-e859976034c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08dec2d3-e279-4e38-a322-590af6f23e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:21 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Volume 7ba23422-b9a9-4843-9b3e-f103c882da6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba23422-b9a9-4843-9b3e-f103c882da6d', 'volume_size': 1} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903821404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba23422-b9a9-4843-9b3e-f103c882da6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:22Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Creating volume 7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:21 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:22 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d 1073741824 Apr 17 15:56:22 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:22 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.647s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:22 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3 Apr 17 15:56:22 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:22 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d 1073741824" returned: 0 in 0.678s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:22 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d Apr 17 15:56:22 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:22 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" returned: 0 in 0.676s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Lock "cinder-quobyte-c70647ee-9ad9-48c6-9443-1fd43c4b79d3" released by "delete_volume" :: held 1.352s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:22 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Created reservations ['537a55f4-fa19-4a0c-876c-9de2c1d0a482', '8c0bd067-c890-4bd3-b7c5-5c173cd64f56', '24b3f098-628a-4608-89ab-9e7dbfcd259b', '142d79a8-3343-4e1f-b1d9-7509ad6484d4'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:23 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:23 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:23 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d" returned: 0 in 0.512s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08dec2d3-e279-4e38-a322-590af6f23e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba23422-b9a9-4843-9b3e-f103c882da6d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef64d132-9002-47c0-9c18-8d7d81e47a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:23 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Volume volume-7ba23422-b9a9-4843-9b3e-f103c882da6d (7ba23422-b9a9-4843-9b3e-f103c882da6d): created successfully Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef64d132-9002-47c0-9c18-8d7d81e47a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (0b383e32-527a-4744-a21e-9deca777e18e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:23 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-adb7d30f-7da7-481a-bbd0-463cf28da0a9 tempest-VolumesSnapshotTestJSON-599023167 None] Created volume successfully. Apr 17 15:56:23 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:23 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Deleted volume successfully. Apr 17 15:56:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9bb556e9-684b-4933-9d28-5e299c858ff0 tempest-VolumesActionsTest-860626120 None] Lock "cinder-c70647ee-9ad9-48c6-9443-1fd43c4b79d3-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Creating offline snapshot aaa400b8-0468-492e-bdd9-1b750137b8db of volume 7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:56:24 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e4498-6032-4524-a69d-734f9ffa4bef]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:24 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d Apr 17 15:56:24 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:24 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d" returned: 0 in 0.619s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:24 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db 1G Apr 17 15:56:24 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Flow 'volume_create_manager' (4aa45142-79d1-4e50-860b-398d79ff2699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdfecae-e6fd-489c-8071-72141d34569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:25 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdfecae-e6fd-489c-8071-72141d34569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-538268182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664d15ec-058f-45fd-b7c5-6a6337f640a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3fdd04765432c9042159b999e01c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:25Z,use_quota=True,user_id='b3d0fe599da24d2184646e6f603c98e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ffca4c-3eb9-4c10-b5d2-8402db656cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ffca4c-3eb9-4c10-b5d2-8402db656cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8724151a-fc42-4008-a937-8f0d3889ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8724151a-fc42-4008-a937-8f0d3889ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664d15ec-058f-45fd-b7c5-6a6337f640a0', 'volume_name': 'volume-664d15ec-058f-45fd-b7c5-6a6337f640a0', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8b48b7-40fb-4c2e-a9ee-d378a142bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8b48b7-40fb-4c2e-a9ee-d378a142bf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0962db55-c511-40ba-a09b-5993432d76db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:25 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Volume 664d15ec-058f-45fd-b7c5-6a6337f640a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664d15ec-058f-45fd-b7c5-6a6337f640a0', 'volume_size': 1} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db 1G" returned: 0 in 0.706s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba23422-b9a9-4843-9b3e-f103c882da6d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:25 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba23422-b9a9-4843-9b3e-f103c882da6d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db Apr 17 15:56:25 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:26 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba23422-b9a9-4843-9b3e-f103c882da6d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db" returned: 0 in 0.472s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:26 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db is being set with open permissions: ugo+rw Apr 17 15:56:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:26 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db Apr 17 15:56:26 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:26 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db" returned: 0 in 0.541s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:26 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.info Apr 17 15:56:26 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:27 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.info" returned: 0 in 0.509s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:27 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.info is being set with open permissions: ugo+rw Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:27 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.info Apr 17 15:56:27 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:27 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.info" returned: 0 in 0.558s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.471s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.122s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-538268182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664d15ec-058f-45fd-b7c5-6a6337f640a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3fdd04765432c9042159b999e01c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:25Z,use_quota=True,user_id='b3d0fe599da24d2184646e6f603c98e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Creating volume 664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:27 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:27 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 1073741824 Apr 17 15:56:27 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:27 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9f35d88d-2d3e-4454-ba54-5655afcc3cdf tempest-VolumesSnapshotTestJSON-599023167 None] Create snapshot completed successfully Apr 17 15:56:28 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 1073741824" returned: 0 in 0.559s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:28 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 Apr 17 15:56:28 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (2286591f-913b-4998-9fa7-0f1afd22ce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd600b4-8c1d-48a2-98aa-5aeab3cfbf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd600b4-8c1d-48a2-98aa-5aeab3cfbf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1609978186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76b8424-a7fe-4208-b041-16e3d5c11727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e797db8c1a456ba3c2822f9e9f987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aaa400b8-0468-492e-bdd9-1b750137b8db,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:29Z,use_quota=True,user_id='387089af9b0140918096b64e30c0c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:28 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a60eb13-ebb1-4aa8-a433-92c3f8378ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a60eb13-ebb1-4aa8-a433-92c3f8378ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117cb384-3b35-491e-8f45-cc1f92cead5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117cb384-3b35-491e-8f45-cc1f92cead5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e76b8424-a7fe-4208-b041-16e3d5c11727', 'volume_name': 'volume-e76b8424-a7fe-4208-b041-16e3d5c11727', 'volume_size': 1, 'snapshot_id': 'aaa400b8-0468-492e-bdd9-1b750137b8db'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daadbdb5-0e9d-4f13-b49e-5331ff54e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daadbdb5-0e9d-4f13-b49e-5331ff54e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40f7cb3-58ac-4efe-b861-189fa63b7734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:28 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Volume e76b8424-a7fe-4208-b041-16e3d5c11727: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e76b8424-a7fe-4208-b041-16e3d5c11727', 'volume_size': 1, 'snapshot_id': 'aaa400b8-0468-492e-bdd9-1b750137b8db'} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0" returned: 0 in 0.617s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-aaa400b8-0468-492e-bdd9-1b750137b8db-e76b8424-a7fe-4208-b041-16e3d5c11727" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (844a8662-3b55-44c0-be73-79e3c7be0bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bf1842-f321-4ecf-94a4-86d5abd93fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0962db55-c511-40ba-a09b-5993432d76db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664d15ec-058f-45fd-b7c5-6a6337f640a0', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00317e6c-9d4b-4a06-a98b-16e861c63434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-aaa400b8-0468-492e-bdd9-1b750137b8db-e76b8424-a7fe-4208-b041-16e3d5c11727" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Creating volume e76b8424-a7fe-4208-b041-16e3d5c11727 from snapshot aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-e76b8424-a7fe-4208-b041-16e3d5c11727" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bf1842-f321-4ecf-94a4-86d5abd93fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1410298715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e739893-f738-4057-b2df-eb131c655e59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:29Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b3fc43-4563-4121-a5d9-399c5e04b26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b3fc43-4563-4121-a5d9-399c5e04b26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5879a613-b565-423f-a2eb-b56060ca7129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5879a613-b565-423f-a2eb-b56060ca7129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e739893-f738-4057-b2df-eb131c655e59', 'volume_name': 'volume-8e739893-f738-4057-b2df-eb131c655e59', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec60b3cd-1080-4073-8f4b-16ae18389615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec60b3cd-1080-4073-8f4b-16ae18389615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8283580e-0c75-4e44-9463-5de169f24712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Volume 8e739893-f738-4057-b2df-eb131c655e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e739893-f738-4057-b2df-eb131c655e59', 'volume_size': 1} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Volume volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 (664d15ec-058f-45fd-b7c5-6a6337f640a0): created successfully Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00317e6c-9d4b-4a06-a98b-16e861c63434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Flow 'volume_create_manager' (4aa45142-79d1-4e50-860b-398d79ff2699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-e76b8424-a7fe-4208-b041-16e3d5c11727" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] snapshot: aaa400b8-0468-492e-bdd9-1b750137b8db, volume: e76b8424-a7fe-4208-b041-16e3d5c11727, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 15:56:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-2918acdd-ccc7-4046-8c7a-f9ee92846e05 req-f22625a8-9a42-45a4-a883-b737c15bc9d2 tempest-VolumesSnapshotsTestJSON-750069882 None] Created volume successfully. Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d29c8b-2af7-48d7-8608-1e5a2269e3a8]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:29 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db Apr 17 15:56:29 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:29 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db" returned: 0 in 0.475s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba23422-b9a9-4843-9b3e-f103c882da6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4568f6e-0611-45fb-b43b-5d37e7b63f2c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:29 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d Apr 17 15:56:29 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:30 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d" returned: 0 in 0.647s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:30 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 15:56:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:30 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 Apr 17 15:56:30 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:32 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727" returned: 0 in 2.421s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:32 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf78e03-e9a3-4fa4-9ce1-ca05dced41f5]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:32 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d Apr 17 15:56:32 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-c6181601-be6c-488f-885e-28071caa3271 req-ace558f2-c519-43ec-8aab-1b37f2e3903f tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Terminate volume connection completed successfully. Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-c6181601-be6c-488f-885e-28071caa3271 req-ace558f2-c519-43ec-8aab-1b37f2e3903f tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Deleting attachment 7816382f-0fc2-4813-b311-54f7ae6c25f8. {{(pid=81996) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 17 15:56:33 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d" returned: 0 in 0.627s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:56:33 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Converted 1024.00 MB image at 422.75 MB/s Apr 17 15:56:33 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 is being set with open permissions: ugo+rw Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:33 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 Apr 17 15:56:33 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "cinder-b0cd3a95-9404-42c8-b31b-238ebab9eef9-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-b0cd3a95-9404-42c8-b31b-238ebab9eef9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "cinder-quobyte-b0cd3a95-9404-42c8-b31b-238ebab9eef9" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-quobyte-b0cd3a95-9404-42c8-b31b-238ebab9eef9" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e1175d-b18c-4a89-b6c2-929c500be49f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:33 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727" returned: 0 in 0.449s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-e76b8424-a7fe-4208-b041-16e3d5c11727" released by "_copy_volume_from_snapshot" :: held 4.699s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-aaa400b8-0468-492e-bdd9-1b750137b8db-e76b8424-a7fe-4208-b041-16e3d5c11727" released by "_create_volume_from_snapshot" :: held 4.762s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.810s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.721s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1410298715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e739893-f738-4057-b2df-eb131c655e59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:29Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Creating volume 8e739893-f738-4057-b2df-eb131c655e59 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:33 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:33 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 1073741824 Apr 17 15:56:33 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40f7cb3-58ac-4efe-b861-189fa63b7734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76b8424-a7fe-4208-b041-16e3d5c11727', 'volume_size': 1, 'snapshot_id': 'aaa400b8-0468-492e-bdd9-1b750137b8db'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5436edbc-5f66-4528-ac39-c658f361dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:33 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Volume volume-e76b8424-a7fe-4208-b041-16e3d5c11727 (e76b8424-a7fe-4208-b041-16e3d5c11727): created successfully Apr 17 15:56:33 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5436edbc-5f66-4528-ac39-c658f361dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:33 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Flow 'volume_create_manager' (2286591f-913b-4998-9fa7-0f1afd22ce84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8124c693-eac2-409b-ae9b-889360affa30 tempest-VolumesSnapshotTestJSON-599023167 None] Created volume successfully. Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-e76b8424-a7fe-4208-b041-16e3d5c11727-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-e76b8424-a7fe-4208-b041-16e3d5c11727-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:34 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-e76b8424-a7fe-4208-b041-16e3d5c11727" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9" returned: 0 in 0.582s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-e76b8424-a7fe-4208-b041-16e3d5c11727" acquired by "delete_volume" :: waited 0.023s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:34 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9 Apr 17 15:56:34 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd9ede-3973-4b42-ad97-692afdd2321f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:34 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:34 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:34 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 1073741824" returned: 0 in 0.612s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:34 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 Apr 17 15:56:34 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:34 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 Apr 17 15:56:34 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:34 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0cd3a95-9404-42c8-b31b-238ebab9eef9" returned: 0 in 0.433s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-quobyte-b0cd3a95-9404-42c8-b31b-238ebab9eef9" released by "delete_volume" :: held 1.038s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.quota [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Created reservations ['730f3bc7-c38d-48b1-ab1e-1adc5a0eb885', 'b3356f3c-1002-4840-9499-dfba9e2f6436', 'e069a51e-00e8-4d01-a379-2462ecb48827', 'df2237b0-633e-439a-bfb5-5f4e6341e410'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:34 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.443s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:34 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59" returned: 0 in 0.475s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.772s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:34 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:34 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8283580e-0c75-4e44-9463-5de169f24712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e739893-f738-4057-b2df-eb131c655e59', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078fca69-6553-4ba7-8fe9-6ecd8dccdf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Creating offline snapshot 7ba827e7-625c-4931-8254-802aa447a5a5 of volume 664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:56:34 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Volume volume-8e739893-f738-4057-b2df-eb131c655e59 (8e739893-f738-4057-b2df-eb131c655e59): created successfully Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078fca69-6553-4ba7-8fe9-6ecd8dccdf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (844a8662-3b55-44c0-be73-79e3c7be0bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb81d459-a315-49da-95a3-6b189e478c76]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:34 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727" returned: 0 in 0.583s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6802b48c-e339-464c-b923-4988221b8528 tempest-VolumesGetTest-313547832 None] Created volume successfully. Apr 17 15:56:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:34 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727 Apr 17 15:56:34 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:35 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 Apr 17 15:56:35 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:35 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.420s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.manager [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Deleted volume successfully. Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-c6181601-be6c-488f-885e-28071caa3271 req-9ab8f871-5dcf-4497-bd04-d32dac0c0d49 tempest-ServerBootFromVolumeStableRescueTest-434083933 None] Lock "cinder-b0cd3a95-9404-42c8-b31b-238ebab9eef9-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:35 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e76b8424-a7fe-4208-b041-16e3d5c11727" returned: 0 in 0.524s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-e76b8424-a7fe-4208-b041-16e3d5c11727" released by "delete_volume" :: held 1.155s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:35 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0" returned: 0 in 0.591s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:35 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 1G Apr 17 15:56:35 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['c9957f28-4c71-46c0-80d6-f02c21f43fae', '2f8f1dac-0970-4fef-928c-22601e4acddb', 'f766e646-5bb4-4d30-a192-a6004a482cd5', '6bee84d5-c36e-41d5-86d7-5d83f7d68c39'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:35 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:35 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (568cf485-75d9-4684-826b-1ff129aaf149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d50ee42-0667-467f-a559-85d945bf4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d50ee42-0667-467f-a559-85d945bf4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1437768117',display_name='tempest-VolumesGetTest-Volume-1455974411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c56ace8-5b03-4be9-b209-782d5cd8947e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:36Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06307267-1110-4e92-bf5f-16b7f729a705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06307267-1110-4e92-bf5f-16b7f729a705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c5cc62-0685-426e-9a55-ebf0304140c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c5cc62-0685-426e-9a55-ebf0304140c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c56ace8-5b03-4be9-b209-782d5cd8947e', 'volume_name': 'volume-6c56ace8-5b03-4be9-b209-782d5cd8947e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359aca73-6d1e-477e-881b-b7ae5c3ff598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359aca73-6d1e-477e-881b-b7ae5c3ff598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3959bad0-0fbb-4731-aead-8416c6acb433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:35 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Volume 6c56ace8-5b03-4be9-b209-782d5cd8947e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c56ace8-5b03-4be9-b209-782d5cd8947e', 'volume_size': 1} Apr 17 15:56:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:36 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 1G" returned: 0 in 0.560s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:36 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 Apr 17 15:56:36 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:36 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Deleted volume successfully. Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c390d6e3-11f1-41af-9fa5-8f4053272afa tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-e76b8424-a7fe-4208-b041-16e3d5c11727-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-aaa400b8-0468-492e-bdd9-1b750137b8db-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-aaa400b8-0468-492e-bdd9-1b750137b8db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-7ba23422-b9a9-4843-9b3e-f103c882da6d" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-7ba23422-b9a9-4843-9b3e-f103c882da6d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-aaa400b8-0468-492e-bdd9-1b750137b8db" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-aaa400b8-0468-492e-bdd9-1b750137b8db" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Deleting offline snapshot aaa400b8-0468-492e-bdd9-1b750137b8db of volume 7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] snapshot_file for this snap is: volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af1db3-4327-4f28-ad43-86faa1cb8b13]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:36 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5" returned: 0 in 0.569s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:36 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 is being set with open permissions: ugo+rw Apr 17 15:56:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:36 devstack sudo[86800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db Apr 17 15:56:36 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:36 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 Apr 17 15:56:36 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:37 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db" returned: 0 in 0.574s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba23422-b9a9-4843-9b3e-f103c882da6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:56:37 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5" returned: 0 in 0.521s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dd59d3-f7cc-476c-bf41-f8c7308585a4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:37 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.info Apr 17 15:56:37 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:37 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d Apr 17 15:56:37 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:37 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:37 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.info" returned: 0 in 0.456s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:37 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.info is being set with open permissions: ugo+rw Apr 17 15:56:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:37 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db Apr 17 15:56:37 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:37 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.info Apr 17 15:56:37 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:38 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.info" returned: 0 in 0.520s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1437768117',display_name='tempest-VolumesGetTest-Volume-1455974411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c56ace8-5b03-4be9-b209-782d5cd8947e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:36Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Creating volume 6c56ace8-5b03-4be9-b209-782d5cd8947e {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:38 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:38 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db" returned: 0 in 0.602s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:38 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e 1073741824 Apr 17 15:56:38 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:38 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-0ba7b8b9-3684-4e69-bc32-c0af51ca8a50 req-9fa5a4c1-6b5e-4150-b914-1cb70f37489b tempest-VolumesSnapshotsTestJSON-750069882 None] Create snapshot completed successfully Apr 17 15:56:38 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db Apr 17 15:56:38 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:38 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d.aaa400b8-0468-492e-bdd9-1b750137b8db" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-aaa400b8-0468-492e-bdd9-1b750137b8db" released by "_delete_snapshot" :: held 2.195s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-7ba23422-b9a9-4843-9b3e-f103c882da6d" released by "delete_snapshot" :: held 2.207s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['e21cb6e5-6c9a-416b-be1b-ebaeb2a74d1a', '3274ccf9-f84f-4a17-865e-37a94804ec59', '7d0edddf-3939-4578-ae86-6b452f6bb29f', '4b58a5a0-4fbf-4428-ae09-3bcf8b6fbd12'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:38 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e 1073741824" returned: 0 in 0.604s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:38 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e Apr 17 15:56:38 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:38 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Delete snapshot completed successfully. Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c5a50ee-b83f-4a5f-9826-7c5b857b4ea3 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-aaa400b8-0468-492e-bdd9-1b750137b8db-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "cinder-7ba827e7-625c-4931-8254-802aa447a5a5-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-7ba827e7-625c-4931-8254-802aa447a5a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "cinder-quobyte-664d15ec-058f-45fd-b7c5-6a6337f640a0" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-quobyte-664d15ec-058f-45fd-b7c5-6a6337f640a0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "cinder-quobyte-7ba827e7-625c-4931-8254-802aa447a5a5" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-quobyte-7ba827e7-625c-4931-8254-802aa447a5a5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Deleting offline snapshot 7ba827e7-625c-4931-8254-802aa447a5a5 of volume 664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] snapshot_file for this snap is: volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:56:38 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c325baf0-1aef-4b03-a26d-2b60fa0ad688]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:39 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 Apr 17 15:56:39 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:39 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3959bad0-0fbb-4731-aead-8416c6acb433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c56ace8-5b03-4be9-b209-782d5cd8947e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da5a843-6043-4eea-90bd-5a6f902c09d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:39 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Volume volume-6c56ace8-5b03-4be9-b209-782d5cd8947e (6c56ace8-5b03-4be9-b209-782d5cd8947e): created successfully Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da5a843-6043-4eea-90bd-5a6f902c09d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (568cf485-75d9-4684-826b-1ff129aaf149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:39 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7ededa30-5b5b-4aba-87fa-a4d523d037ac tempest-VolumesGetTest-313547832 None] Created volume successfully. Apr 17 15:56:39 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5" returned: 0 in 0.600s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664d15ec-058f-45fd-b7c5-6a6337f640a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[50adf359-f2fa-44bb-9220-7c841d8e78bc]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:39 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 Apr 17 15:56:39 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-7ba23422-b9a9-4843-9b3e-f103c882da6d-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-7ba23422-b9a9-4843-9b3e-f103c882da6d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-7ba23422-b9a9-4843-9b3e-f103c882da6d" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-7ba23422-b9a9-4843-9b3e-f103c882da6d" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeb98d6-1e33-4d17-b932-8bcb09858ea2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:39 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d Apr 17 15:56:39 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:40 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0" returned: 0 in 0.519s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:40 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 Apr 17 15:56:40 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-6c56ace8-5b03-4be9-b209-782d5cd8947e-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Lock "cinder-6c56ace8-5b03-4be9-b209-782d5cd8947e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-6c56ace8-5b03-4be9-b209-782d5cd8947e" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-6c56ace8-5b03-4be9-b209-782d5cd8947e" acquired by "delete_volume" :: waited 0.017s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae08e42-a383-45a4-b74e-b7cb470a1564]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:40 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d" returned: 0 in 0.536s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:40 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d Apr 17 15:56:40 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:40 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e Apr 17 15:56:40 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:40 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5" returned: 0 in 0.592s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:40 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5 Apr 17 15:56:40 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:40 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ba23422-b9a9-4843-9b3e-f103c882da6d" returned: 0 in 0.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:40 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e" returned: 0 in 0.546s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-7ba23422-b9a9-4843-9b3e-f103c882da6d" released by "delete_volume" :: held 1.085s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:40 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e Apr 17 15:56:40 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['1d0dd962-402b-45db-a907-fbafa48dd53b', '9edca298-41e1-4d5a-8cdd-ab7aa92f750f', '4d6d1128-12be-4801-ad0e-a09af4cf40fc', 'e33ea009-ba5d-4ce6-b576-15d21a60d9c2'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:40 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:40 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:41 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0.7ba827e7-625c-4931-8254-802aa447a5a5" returned: 0 in 0.477s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-quobyte-7ba827e7-625c-4931-8254-802aa447a5a5" released by "_delete_snapshot" :: held 2.259s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-quobyte-664d15ec-058f-45fd-b7c5-6a6337f640a0" released by "delete_snapshot" :: held 2.279s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.quota [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Created reservations ['169826aa-7b7a-4f16-9cfc-b95713fd6692', 'b84a83a3-24f4-47b3-b3d4-88667f983c27', '571bfec6-b9de-40a3-ade8-394ee5df9d1d', '8ac34fea-dcfe-47b2-b97c-a728f5468563'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Delete snapshot completed successfully. Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-93d5e6b4-af67-48bf-bed0-2136c0e3180f req-032f0852-71d2-44a8-a2ad-981c61ceea14 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-7ba827e7-625c-4931-8254-802aa447a5a5-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:41 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c56ace8-5b03-4be9-b209-782d5cd8947e" returned: 0 in 0.502s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-6c56ace8-5b03-4be9-b209-782d5cd8947e" released by "delete_volume" :: held 1.076s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Created reservations ['dade532b-f3d4-4dcb-abe8-f0cdc6b3255d', '9b9d478f-f5f2-4da2-b018-70ae0d59a17a', '38ee0f7e-f800-4023-a535-24692b07b0c1', '67b116d5-af6a-4729-8220-aae3a82749bc'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:41 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.474s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Deleted volume successfully. Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e95b5be3-45c0-4ef0-a6d7-32e114d0bcab tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-7ba23422-b9a9-4843-9b3e-f103c882da6d-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:41 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:41 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:41 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.454s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Deleted volume successfully. Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-288f0e8e-ab68-4102-8648-faed67613cc2 tempest-VolumesGetTest-313547832 None] Lock "cinder-6c56ace8-5b03-4be9-b209-782d5cd8947e-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-18e6fdf1-6da9-428b-b925-9ed37c82cf49-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-18e6fdf1-6da9-428b-b925-9ed37c82cf49-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "cinder-quobyte-18e6fdf1-6da9-428b-b925-9ed37c82cf49" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-18e6fdf1-6da9-428b-b925-9ed37c82cf49" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a57cc91-6d69-4a1e-89eb-09a53f464a58]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:42 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 Apr 17 15:56:42 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "cinder-664d15ec-058f-45fd-b7c5-6a6337f640a0-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-664d15ec-058f-45fd-b7c5-6a6337f640a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "cinder-quobyte-664d15ec-058f-45fd-b7c5-6a6337f640a0" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-quobyte-664d15ec-058f-45fd-b7c5-6a6337f640a0" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea4dd18-8e62-4401-b67a-e4bb0753c7fe]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:42 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 Apr 17 15:56:42 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-8e739893-f738-4057-b2df-eb131c655e59-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Lock "cinder-8e739893-f738-4057-b2df-eb131c655e59-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-8e739893-f738-4057-b2df-eb131c655e59" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-8e739893-f738-4057-b2df-eb131c655e59" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c9c4c2-ea94-444a-b362-757933fbb3c7]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:42 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49" returned: 0 in 0.551s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:42 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:42 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:42 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49 Apr 17 15:56:42 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:42 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0" returned: 0 in 0.562s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:42 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0 Apr 17 15:56:42 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:43 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-18e6fdf1-6da9-428b-b925-9ed37c82cf49" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-quobyte-18e6fdf1-6da9-428b-b925-9ed37c82cf49" released by "delete_volume" :: held 1.043s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:43 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59" returned: 0 in 0.556s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:43 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59 Apr 17 15:56:43 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Created reservations ['f8eb15e7-a970-4cd9-a67f-6490a03048c0', '8098f71e-fb44-4581-a244-d2da0ec4b249', 'e9781a72-f306-452c-8738-973d63bedde1', 'a2e422d5-b59c-4062-bd0f-e8c378c2d853'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:43 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:43 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:43 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-664d15ec-058f-45fd-b7c5-6a6337f640a0" returned: 0 in 0.561s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-quobyte-664d15ec-058f-45fd-b7c5-6a6337f640a0" released by "delete_volume" :: held 1.163s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.quota [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Created reservations ['f16c1e5d-7a83-4c13-b23e-0f661f7fc3b4', '66f301f4-a995-4572-98e3-d7411a8a86cb', '7dabd1e7-18e5-4fbf-9bcd-951f8579680f', '888ed032-f6f6-4f19-9908-654048eee40b'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:43 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:43 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:43 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8e739893-f738-4057-b2df-eb131c655e59" returned: 0 in 0.511s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-8e739893-f738-4057-b2df-eb131c655e59" released by "delete_volume" :: held 1.090s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Created reservations ['ca148291-518e-4ce6-a4b8-cef8eceac2f8', 'a4b98d67-3390-4434-99b6-a6df9bae635b', '02bf4704-b19f-40e2-953e-3d04bd531088', '4ddf94a8-05af-4d07-86b5-099d0d6b6f4f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:43 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.539s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Deleted volume successfully. Apr 17 15:56:43 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:56:43 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-93c7583f-bd33-4e4e-8044-050c6ef3da10 tempest-VolumesSnapshotTestJSON-599023167 None] Lock "cinder-18e6fdf1-6da9-428b-b925-9ed37c82cf49-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:44 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.498s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG cinder.manager [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:44 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Deleted volume successfully. Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-5ec57a8c-37c1-428f-a1c3-6f27cabbe0d0 req-ab9a588a-e7c1-46dd-8fb4-344a10a58b06 tempest-VolumesSnapshotsTestJSON-750069882 None] Lock "cinder-664d15ec-058f-45fd-b7c5-6a6337f640a0-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:44 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:56:44 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Deleted volume successfully. Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-40d30c04-669a-4a70-bf25-425cae419407 tempest-VolumesGetTest-313547832 None] Lock "cinder-8e739893-f738-4057-b2df-eb131c655e59-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (9212c76a-87a9-4697-882a-935468d5c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04aa766-4ef4-4192-8fc8-5a7f6b0f5af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04aa766-4ef4-4192-8fc8-5a7f6b0f5af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-366311319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9353b14a-4738-49b0-a93b-3b0f22fcb261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:45Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4272ec-312a-4c49-b24a-383cab8c4fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4272ec-312a-4c49-b24a-383cab8c4fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9409e1b0-f294-4f6f-b2fe-9031b98e6688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9409e1b0-f294-4f6f-b2fe-9031b98e6688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9353b14a-4738-49b0-a93b-3b0f22fcb261', 'volume_name': 'volume-9353b14a-4738-49b0-a93b-3b0f22fcb261', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50b12f4-1379-44eb-b38f-e8af4a4e6bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50b12f4-1379-44eb-b38f-e8af4a4e6bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe07da1-b7f5-4263-9d52-6210844a4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Volume 9353b14a-4738-49b0-a93b-3b0f22fcb261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9353b14a-4738-49b0-a93b-3b0f22fcb261', 'volume_size': 1} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-366311319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9353b14a-4738-49b0-a93b-3b0f22fcb261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:45Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Creating volume 9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:45 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:45 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 1073741824 Apr 17 15:56:45 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:45 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 1073741824" returned: 0 in 0.588s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:45 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 Apr 17 15:56:45 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:46 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261" returned: 0 in 0.600s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe07da1-b7f5-4263-9d52-6210844a4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9353b14a-4738-49b0-a93b-3b0f22fcb261', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e51bbfa-94ab-4c7c-aa6a-53a484a82f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Volume volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 (9353b14a-4738-49b0-a93b-3b0f22fcb261): created successfully Apr 17 15:56:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e51bbfa-94ab-4c7c-aa6a-53a484a82f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (9212c76a-87a9-4697-882a-935468d5c1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-560e126a-3711-4d74-827f-2f0c2c281b7a tempest-VolumesGetTest-313547832 None] Created volume successfully. Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (c3fbd603-6083-41e6-90e5-d5d55ea73396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817e4b93-72b7-47c9-a75c-53abed2b6fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817e4b93-72b7-47c9-a75c-53abed2b6fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1395275457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a751ccdf-edab-496e-84b6-13e9de53e6d7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9353b14a-4738-49b0-a93b-3b0f22fcb261,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:47Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065c0a3b-858d-4cfa-94ff-71f6339486d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065c0a3b-858d-4cfa-94ff-71f6339486d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a10902-efcf-4fd4-a11c-20f0ccf77612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a10902-efcf-4fd4-a11c-20f0ccf77612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a751ccdf-edab-496e-84b6-13e9de53e6d7', 'volume_name': 'volume-a751ccdf-edab-496e-84b6-13e9de53e6d7', 'volume_size': 1, 'source_volid': '9353b14a-4738-49b0-a93b-3b0f22fcb261', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a51aa1-85c0-457b-b830-f7018fa33605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a51aa1-85c0-457b-b830-f7018fa33605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534e6b19-59cc-4070-8569-317d22f407bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Volume a751ccdf-edab-496e-84b6-13e9de53e6d7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a751ccdf-edab-496e-84b6-13e9de53e6d7', 'volume_size': 1, 'source_volid': '9353b14a-4738-49b0-a93b-3b0f22fcb261', 'source_volstatus': 'available'} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:47 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Cloning volume 9353b14a-4738-49b0-a93b-3b0f22fcb261 to volume a751ccdf-edab-496e-84b6-13e9de53e6d7 Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Creating offline snapshot 2cd5e56a-ac17-4b0e-a254-396e2b714584 of volume 9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a12f1b-5a3b-462a-9531-8e52ea8d4273]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:47 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 Apr 17 15:56:47 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Flow 'volume_create_manager' (988985bc-3aab-41e7-807b-dce627f8d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27793e77-d23a-4bd9-935a-a883683ae404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27793e77-d23a-4bd9-935a-a883683ae404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1917190818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0457c954-e91d-495d-a593-042ec3e39ad4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8707f8e091b24a2f9f05915d2237bb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:48Z,use_quota=True,user_id='d4d31d02b22141dda6a9a7e160468be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78b7ca5-2430-426c-9320-6f366e0aa28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78b7ca5-2430-426c-9320-6f366e0aa28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5563721a-6388-4675-9e34-c3ba687dd951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5563721a-6388-4675-9e34-c3ba687dd951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0457c954-e91d-495d-a593-042ec3e39ad4', 'volume_name': 'volume-0457c954-e91d-495d-a593-042ec3e39ad4', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e83ae1-e78a-41a7-827d-3193ef4b4f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e83ae1-e78a-41a7-827d-3193ef4b4f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7bb664-aa2e-41ea-8725-02cd4064fc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:47 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Volume 0457c954-e91d-495d-a593-042ec3e39ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0457c954-e91d-495d-a593-042ec3e39ad4', 'volume_size': 1} Apr 17 15:56:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:48 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261" returned: 0 in 0.611s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:48 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 1G Apr 17 15:56:48 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:48 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 1G" returned: 0 in 0.642s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:48 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 Apr 17 15:56:48 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-85902f2f-829e-4c98-8e51-553a37eaa808 tempest-GroupSnapshotsTest-969576532 None] Group tempest-GroupSnapshotsTest-Group-549692540: creating Apr 17 15:56:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-85902f2f-829e-4c98-8e51-553a37eaa808 tempest-GroupSnapshotsTest-969576532 None] Group tempest-GroupSnapshotsTest-Group-549692540: created successfully Apr 17 15:56:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-85902f2f-829e-4c98-8e51-553a37eaa808 tempest-GroupSnapshotsTest-969576532 None] Create group completed successfully. Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Flow 'volume_create_manager' (1a150f6e-9fc6-4fe4-b7c9-29fcf7bb0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc382a6e-edd3-48da-a4c0-0bea16b4ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc382a6e-edd3-48da-a4c0-0bea16b4ac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-127091074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66bf3b-6c86-48ab-9a71-53d537f1dd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6eadd9a4a0544e5be9b6015fa375cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:49Z,use_quota=True,user_id='a453d9b3619a43e78a33e89a4abd235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464230af-386a-427d-bfad-ded0378a55bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464230af-386a-427d-bfad-ded0378a55bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7072a78b-3093-491c-bf4b-83bf9937edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7072a78b-3093-491c-bf4b-83bf9937edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a66bf3b-6c86-48ab-9a71-53d537f1dd9c', 'volume_name': 'volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b4ee3f-4388-4116-b030-d90f3cfbef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b4ee3f-4388-4116-b030-d90f3cfbef4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c7ed4a-9d04-4651-9e79-7680ac3b726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:49 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c', 'volume_size': 1} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:49 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584" returned: 0 in 0.507s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:49 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 is being set with open permissions: ugo+rw Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:49 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 Apr 17 15:56:49 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:49 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584" returned: 0 in 0.424s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:49 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.info Apr 17 15:56:49 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:50 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.info" returned: 0 in 0.439s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:50 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.info is being set with open permissions: ugo+rw Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:50 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.info Apr 17 15:56:50 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (04a33499-1e42-4ae8-880c-9800fea5bdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77d86cd-2bc2-4c9b-bfca-71455ce0ece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77d86cd-2bc2-4c9b-bfca-71455ce0ece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1888187034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18d1b5fe-adcf-4c84-9b45-5126013c0d75,host='devstack@QuobyteHD#QuobyteHD',id=a470d089-fc48-4522-8311-3ce6481e2b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:50Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8084085-4218-4416-845a-d0b60a87f65a),volume_type_id=f8084085-4218-4416-845a-d0b60a87f65a)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cdd4a0-0008-4a93-803b-df72fc060f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cdd4a0-0008-4a93-803b-df72fc060f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d0410-eed9-40ba-a64f-6a2951a6a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d0410-eed9-40ba-a64f-6a2951a6a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a470d089-fc48-4522-8311-3ce6481e2b2d', 'volume_name': 'volume-a470d089-fc48-4522-8311-3ce6481e2b2d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad877641-6185-40d8-b7ce-cbc8f48ee7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad877641-6185-40d8-b7ce-cbc8f48ee7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bca673d-d6b7-4b39-aab6-b15118f30c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:50 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Volume a470d089-fc48-4522-8311-3ce6481e2b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a470d089-fc48-4522-8311-3ce6481e2b2d', 'volume_size': 1} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:50 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.info" returned: 0 in 0.458s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-a751ccdf-edab-496e-84b6-13e9de53e6d7" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-a751ccdf-edab-496e-84b6-13e9de53e6d7" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] snapshot: 2cd5e56a-ac17-4b0e-a254-396e2b714584, volume: a751ccdf-edab-496e-84b6-13e9de53e6d7, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bc1c25-e389-4f22-a42e-e82e18f1003a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:50 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 Apr 17 15:56:50 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:51 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9353b14a-4738-49b0-a93b-3b0f22fcb261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d0c98-03eb-4859-b5bf-29fc9ec044de]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:51 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 Apr 17 15:56:51 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:51 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 15:56:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:51 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 Apr 17 15:56:51 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:54 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7" returned: 0 in 2.256s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:54 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9095ce2b-dff0-4e72-89fb-cfee36a870de]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:54 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 Apr 17 15:56:54 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:54 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261" returned: 0 in 0.651s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:54 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:56:54 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Converted 1024.00 MB image at 453.57 MB/s Apr 17 15:56:54 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 is being set with open permissions: ugo+rw Apr 17 15:56:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:54 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 Apr 17 15:56:54 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:55 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7" returned: 0 in 0.434s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-a751ccdf-edab-496e-84b6-13e9de53e6d7" released by "_copy_volume_from_snapshot" :: held 4.396s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-2cd5e56a-ac17-4b0e-a254-396e2b714584" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-2cd5e56a-ac17-4b0e-a254-396e2b714584" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Deleting offline snapshot 2cd5e56a-ac17-4b0e-a254-396e2b714584 of volume 9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] snapshot_file for this snap is: volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[363db1c2-606f-4d82-bf87-2c0badcca977]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:55 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 Apr 17 15:56:55 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:55 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584" returned: 0 in 0.525s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9353b14a-4738-49b0-a93b-3b0f22fcb261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a943d85-1a45-4f77-85eb-36e84e1f3956]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:55 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 Apr 17 15:56:55 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:56 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:56 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 Apr 17 15:56:56 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:56 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584" returned: 0 in 0.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:56 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584 Apr 17 15:56:56 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:57 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261.2cd5e56a-ac17-4b0e-a254-396e2b714584" returned: 0 in 0.421s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-2cd5e56a-ac17-4b0e-a254-396e2b714584" released by "_delete_snapshot" :: held 1.962s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.602s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.267s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1917190818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0457c954-e91d-495d-a593-042ec3e39ad4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8707f8e091b24a2f9f05915d2237bb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:48Z,use_quota=True,user_id='d4d31d02b22141dda6a9a7e160468be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Creating volume 0457c954-e91d-495d-a593-042ec3e39ad4 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:57 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534e6b19-59cc-4070-8569-317d22f407bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a751ccdf-edab-496e-84b6-13e9de53e6d7', 'volume_size': 1, 'source_volid': '9353b14a-4738-49b0-a93b-3b0f22fcb261', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:57 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 1073741824 Apr 17 15:56:57 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf6111b-d167-4e48-ba7d-d34485a81a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Volume volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 (a751ccdf-edab-496e-84b6-13e9de53e6d7): created successfully Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf6111b-d167-4e48-ba7d-d34485a81a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (c3fbd603-6083-41e6-90e5-d5d55ea73396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:57 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-986bb3a8-1643-432a-a8a2-23b554db0e57 tempest-VolumesGetTest-313547832 None] Created volume successfully. Apr 17 15:56:57 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 1073741824" returned: 0 in 0.520s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:57 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 Apr 17 15:56:57 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:58 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4" returned: 0 in 0.432s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.893s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-127091074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66bf3b-6c86-48ab-9a71-53d537f1dd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6eadd9a4a0544e5be9b6015fa375cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:49Z,use_quota=True,user_id='a453d9b3619a43e78a33e89a4abd235d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Creating volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:58 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7bb664-aa2e-41ea-8725-02cd4064fc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0457c954-e91d-495d-a593-042ec3e39ad4', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d78fcc7-df6e-4e4f-b35e-4819c52b52d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:58 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c 1073741824 Apr 17 15:56:58 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:58 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Volume volume-0457c954-e91d-495d-a593-042ec3e39ad4 (0457c954-e91d-495d-a593-042ec3e39ad4): created successfully Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d78fcc7-df6e-4e4f-b35e-4819c52b52d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Flow 'volume_create_manager' (988985bc-3aab-41e7-807b-dce627f8d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-6caa0a05-e202-4fed-9d98-8da64725ca08 req-b4516ec2-b57a-49dd-9ceb-1252ad6ae1e3 tempest-VolumesGetTestJSON-18265807 None] Created volume successfully. Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (39f8f4b9-dde0-4598-9b7d-9fd64fce1839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800e0c1c-9cfb-4d9a-be8c-2ee33c7a140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800e0c1c-9cfb-4d9a-be8c-2ee33c7a140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-775814500',display_name='tempest-VolumesGetTest-Volume-1574247748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564eb967-b0cc-4cf9-ae45-e9945cbb0e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:59Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae34aaf-c898-427c-89f1-f5a602e52607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae34aaf-c898-427c-89f1-f5a602e52607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c864c5-beb4-471b-9075-7eebc6b5c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c864c5-beb4-471b-9075-7eebc6b5c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564eb967-b0cc-4cf9-ae45-e9945cbb0e35', 'volume_name': 'volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b3007b-706e-4f06-9aac-d0f836186cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b3007b-706e-4f06-9aac-d0f836186cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38eb227-f1bc-4e18-87f9-9caf57974d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:58 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Volume 564eb967-b0cc-4cf9-ae45-e9945cbb0e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35', 'volume_size': 1} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:58 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c 1073741824" returned: 0 in 0.581s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:58 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c Apr 17 15:56:58 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Acquiring lock "cinder-0457c954-e91d-495d-a593-042ec3e39ad4-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Lock "cinder-0457c954-e91d-495d-a593-042ec3e39ad4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Acquiring lock "cinder-quobyte-0457c954-e91d-495d-a593-042ec3e39ad4" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Lock "cinder-quobyte-0457c954-e91d-495d-a593-042ec3e39ad4" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e616ecf6-240e-44e2-9885-4a09212d5fd6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:56:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:59 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 Apr 17 15:56:59 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:59 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" returned: 0 in 0.501s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.827s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18d1b5fe-adcf-4c84-9b45-5126013c0d75,created_at=2026-04-17T13:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1888187034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18d1b5fe-adcf-4c84-9b45-5126013c0d75,host='devstack@QuobyteHD#QuobyteHD',id=a470d089-fc48-4522-8311-3ce6481e2b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:50Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8084085-4218-4416-845a-d0b60a87f65a),volume_type_id=f8084085-4218-4416-845a-d0b60a87f65a)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Creating volume a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:56:59 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c7ed4a-9d04-4651-9e79-7680ac3b726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3551df-80c8-4442-a7fb-b258a4aef3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:56:59 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d 1073741824 Apr 17 15:56:59 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:59 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Volume volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c (1a66bf3b-6c86-48ab-9a71-53d537f1dd9c): created successfully Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3551df-80c8-4442-a7fb-b258a4aef3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Flow 'volume_create_manager' (1a150f6e-9fc6-4fe4-b7c9-29fcf7bb0b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:56:59 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-80f5ae2c-4850-4c94-b2aa-6a9e552c8d08 tempest-VolumesSnapshotListTestJSON-1485067724 None] Created volume successfully. Apr 17 15:56:59 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4" returned: 0 in 0.497s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:59 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4 Apr 17 15:56:59 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:59 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d 1073741824" returned: 0 in 0.506s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:56:59 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d Apr 17 15:56:59 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:56:59 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0457c954-e91d-495d-a593-042ec3e39ad4" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:56:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Lock "cinder-quobyte-0457c954-e91d-495d-a593-042ec3e39ad4" released by "delete_volume" :: held 0.999s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.quota [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Created reservations ['3e4ad42a-7d9f-483b-93f6-a06e3795e84e', '1c7df8e0-0b84-4b87-9930-0eeabac23434', '960684f5-1fec-4acf-b294-71f58fb8a2bc', 'fb923080-b128-46cb-a10e-8047979e2fe7'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:00 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:00 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:00 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d" returned: 0 in 0.458s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:56:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-775814500',display_name='tempest-VolumesGetTest-Volume-1574247748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564eb967-b0cc-4cf9-ae45-e9945cbb0e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:56:59Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Creating volume 564eb967-b0cc-4cf9-ae45-e9945cbb0e35 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:00 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bca673d-d6b7-4b39-aab6-b15118f30c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a470d089-fc48-4522-8311-3ce6481e2b2d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:00 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 1073741824 Apr 17 15:57:00 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8f1019-2016-4e77-9f97-e278bc561b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Volume volume-a470d089-fc48-4522-8311-3ce6481e2b2d (a470d089-fc48-4522-8311-3ce6481e2b2d): created successfully Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8f1019-2016-4e77-9f97-e278bc561b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (04a33499-1e42-4ae8-880c-9800fea5bdef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-dc71dc27-5519-4516-a0c2-af391c294298 tempest-GroupSnapshotsTest-969576532 None] Created volume successfully. Apr 17 15:57:00 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.manager [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Deleted volume successfully. Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [req-27cd6e9a-7483-4b76-a9eb-12797afc59ac req-e2525e48-26b1-4c66-beba-e29697ab4d80 tempest-VolumesGetTestJSON-18265807 None] Lock "cinder-0457c954-e91d-495d-a593-042ec3e39ad4-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:00 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 1073741824" returned: 0 in 0.513s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:00 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 Apr 17 15:57:00 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:01 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35" returned: 0 in 0.490s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.295s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38eb227-f1bc-4e18-87f9-9caf57974d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd16ca-c317-4cc4-b0a7-2ed3376ac035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Creating offline snapshot 4a3ccd62-052c-4223-888c-3c8b30fb74e7 of volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Volume volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 (564eb967-b0cc-4cf9-ae45-e9945cbb0e35): created successfully Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd16ca-c317-4cc4-b0a7-2ed3376ac035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (39f8f4b9-dde0-4598-9b7d-9fd64fce1839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e478d85d-a13e-46fa-936c-69d0e1130cb6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:01 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a1c79009-b4ec-44e5-a1cb-434d3d7e9552 tempest-VolumesGetTest-313547832 None] Created volume successfully. Apr 17 15:57:01 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c Apr 17 15:57:01 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:01 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] GroupSnapshot 171cb335-e06a-4ad4-a51c-e50dc70ef811: creating. Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Group snapshot 171cb335-e06a-4ad4-a51c-e50dc70ef811: creating. {{(pid=81996) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 15:57:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-564eb967-b0cc-4cf9-ae45-e9945cbb0e35-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Lock "cinder-564eb967-b0cc-4cf9-ae45-e9945cbb0e35-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-564eb967-b0cc-4cf9-ae45-e9945cbb0e35" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-564eb967-b0cc-4cf9-ae45-e9945cbb0e35" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a665f09-43d0-4240-8f37-34a3930220ef]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:02 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" returned: 0 in 0.679s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:02 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 1G Apr 17 15:57:02 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 Apr 17 15:57:02 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:02 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:02 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35" returned: 0 in 0.568s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:02 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35 Apr 17 15:57:02 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:02 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 1G" returned: 0 in 0.577s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:02 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 Apr 17 15:57:02 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:03 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-564eb967-b0cc-4cf9-ae45-e9945cbb0e35" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-564eb967-b0cc-4cf9-ae45-e9945cbb0e35" released by "delete_volume" :: held 1.059s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Created reservations ['d5579be8-6ad0-463a-b9de-e3d7c749e3e6', '0f40c449-16aa-4a5a-b171-27c3bf7e3be7', 'cb782e4f-aee1-4a77-8e79-d038a602a314', '5e8b429c-3d4a-4ae6-85d1-6ff6a1cc6fbd'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:03 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:03 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:03 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7" returned: 0 in 0.527s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:03 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 is being set with open permissions: ugo+rw Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:03 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 Apr 17 15:57:03 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:03 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.535s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:03 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Deleted volume successfully. Apr 17 15:57:03 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7" returned: 0 in 0.521s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c7ac3e0e-e18c-4516-a15c-3573eed329aa tempest-VolumesGetTest-313547832 None] Lock "cinder-564eb967-b0cc-4cf9-ae45-e9945cbb0e35-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:03 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.info Apr 17 15:57:03 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-a751ccdf-edab-496e-84b6-13e9de53e6d7-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:04 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.info" returned: 0 in 0.478s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:04 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.info is being set with open permissions: ugo+rw Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Lock "cinder-a751ccdf-edab-496e-84b6-13e9de53e6d7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:04 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.info Apr 17 15:57:04 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-a751ccdf-edab-496e-84b6-13e9de53e6d7" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-a751ccdf-edab-496e-84b6-13e9de53e6d7" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90b417-9062-4837-b6eb-56f0662855d6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:04 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 Apr 17 15:57:04 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:04 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.info" returned: 0 in 0.444s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.335s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.103s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Creating offline snapshot 4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd of volume a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:04 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0627acc5-1cda-46cb-94da-ca3e7cf88ad8 tempest-VolumesSnapshotListTestJSON-1485067724 None] Create snapshot completed successfully Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc918b1-cd2b-4b9a-8b71-9a12fcb33385]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:04 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d Apr 17 15:57:04 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:04 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7" returned: 0 in 0.575s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:04 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7 Apr 17 15:57:04 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:05 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d" returned: 0 in 0.552s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:05 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd 1G Apr 17 15:57:05 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:UPDATE=152,cinder:SELECT=144,cinder:INSERT=44,cinder:DELETE=16 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=134,cinder:UPDATE=211,cinder:INSERT=44,cinder:DELETE=15 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:05 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a751ccdf-edab-496e-84b6-13e9de53e6d7" returned: 0 in 0.522s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-a751ccdf-edab-496e-84b6-13e9de53e6d7" released by "delete_volume" :: held 1.134s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Created reservations ['e82a9dc8-6474-44bc-9852-45105a3c2a85', 'dae95851-a96d-4207-860d-b4e1534ffae2', '33925095-9a64-4989-9d08-e4870aae1d6e', 'af4f4f8b-ddd2-47fc-80d9-270c46c63aaf'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:05 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:05 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:05 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd 1G" returned: 0 in 0.628s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a470d089-fc48-4522-8311-3ce6481e2b2d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:05 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a470d089-fc48-4522-8311-3ce6481e2b2d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd Apr 17 15:57:05 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:06 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.501s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:06 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Deleted volume successfully. Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-802724b5-9429-45de-a206-9a7374935631 tempest-VolumesGetTest-313547832 None] Lock "cinder-a751ccdf-edab-496e-84b6-13e9de53e6d7-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:06 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a470d089-fc48-4522-8311-3ce6481e2b2d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" returned: 0 in 0.539s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:06 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:06 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd Apr 17 15:57:06 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-9353b14a-4738-49b0-a93b-3b0f22fcb261-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Lock "cinder-9353b14a-4738-49b0-a93b-3b0f22fcb261-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-9353b14a-4738-49b0-a93b-3b0f22fcb261" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-9353b14a-4738-49b0-a93b-3b0f22fcb261" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc32dad-5e06-4c2c-b8e7-3b6be4f5e35d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:06 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 Apr 17 15:57:06 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:07 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" returned: 0 in 0.560s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:07 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.info Apr 17 15:57:07 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:07 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261" returned: 0 in 0.569s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:07 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261 Apr 17 15:57:07 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:07 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.info" returned: 0 in 0.490s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:07 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:07 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.info Apr 17 15:57:07 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:07 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9353b14a-4738-49b0-a93b-3b0f22fcb261" returned: 0 in 0.540s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-9353b14a-4738-49b0-a93b-3b0f22fcb261" released by "delete_volume" :: held 1.139s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Created reservations ['972a9c91-e95f-450c-96bc-ad1ce17944da', '9ee41b82-07a8-4f7f-8352-71ecff67fa2d', '125b3ba0-ecbf-4366-8a4b-317e489533d0', '7341f582-a89a-4991-8830-3414281c9eca'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:07 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:07 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:08 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.info" returned: 0 in 0.502s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.343s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.661s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Creating offline snapshot 6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 of volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e60f0-2bd3-44de-aa76-2e0133934c43]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1f690fd4-afad-4711-84e1-8cca01fb3080 tempest-GroupSnapshotsTest-969576532 None] group_snapshot 171cb335-e06a-4ad4-a51c-e50dc70ef811: created successfully Apr 17 15:57:08 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 Apr 17 15:57:08 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:08 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Deleted volume successfully. Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7581f83f-8017-47d9-828f-97dd077171dd tempest-VolumesGetTest-313547832 None] Lock "cinder-9353b14a-4738-49b0-a93b-3b0f22fcb261-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:08 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7" returned: 0 in 0.527s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:08 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 1G Apr 17 15:57:08 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (7421ecc9-2a69-4541-95d8-8667dca89736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eba6ce8-2637-4529-9286-a5e1f29adc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eba6ce8-2637-4529-9286-a5e1f29adc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1892781495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a632e60d-483f-4873-bc1f-22376b07b591,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:09Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2469264-335b-451b-8c75-daf4c08b1275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2469264-335b-451b-8c75-daf4c08b1275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547031bf-2f0e-41df-bd54-997a52ce1269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.image.glance [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Creating Keystone auth plugin from conf {{(pid=81996) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 15:57:09 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 1G" returned: 0 in 0.576s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:09 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 Apr 17 15:57:09 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547031bf-2f0e-41df-bd54-997a52ce1269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a632e60d-483f-4873-bc1f-22376b07b591', 'volume_name': 'volume-a632e60d-483f-4873-bc1f-22376b07b591', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb6ce7e-b9eb-4779-8fc1-4f76c710cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb6ce7e-b9eb-4779-8fc1-4f76c710cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab73b2d-07f3-4e36-8f65-e682be147bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:09 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Volume a632e60d-483f-4873-bc1f-22376b07b591: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a632e60d-483f-4873-bc1f-22376b07b591', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Trying to clone a632e60d-483f-4873-bc1f-22376b07b591 from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]). {{(pid=81996) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 15:57:09 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Image download 20.69 MB at 20.69 MB/s Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[977846c6-c714-46f6-a022-43725b43066b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:09 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD Apr 17 15:57:09 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:09 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:09 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 is being set with open permissions: ugo+rw Apr 17 15:57:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:09 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 Apr 17 15:57:09 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:10 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 is fetched for user e0b3c179791949ac8a6324dbe9bab351. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 15:57:10 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" returned: 0 in 0.546s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd-32be63b0-6140-4812-9042-34f011afc708" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e96912c-b83c-44cf-94ec-93a370580f77]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd-32be63b0-6140-4812-9042-34f011afc708" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Creating volume 32be63b0-6140-4812-9042-34f011afc708 from snapshot 4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-32be63b0-6140-4812-9042-34f011afc708" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-32be63b0-6140-4812-9042-34f011afc708" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] snapshot: 4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd, volume: 32be63b0-6140-4812-9042-34f011afc708, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 15:57:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f6dda34d-e461-40c7-a7d0-2afd0837db6b tempest-VolumesSnapshotListTestJSON-1485067724 None] Create snapshot completed successfully Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ce03e-6951-43ec-b5fa-6267c7ee98be]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:10 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD Apr 17 15:57:10 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:10 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd Apr 17 15:57:10 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:10 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:11 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" returned: 0 in 0.633s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a470d089-fc48-4522-8311-3ce6481e2b2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e81924-d76c-4d23-b123-1ca715fd3f59]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:11 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d Apr 17 15:57:11 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:11 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d" returned: 0 in 0.608s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 15:57:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:11 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 Apr 17 15:57:11 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:13 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708" returned: 0 in 2.191s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:13 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb10d68-2896-4618-a881-a7a2b502f271]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:13 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d Apr 17 15:57:13 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Flow 'volume_create_manager' (9446ba0e-bee2-4f0d-a726-ac108f53afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e501879-a37d-488d-81ab-49ade0bb0f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e501879-a37d-488d-81ab-49ade0bb0f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-174361735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58551001a7a41558ec321452b344b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:14Z,use_quota=True,user_id='b660f064016444c88bc3ebf3d4a49b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84361632-49ee-4684-b25e-a4b9297a34a2),volume_type_id=84361632-49ee-4684-b25e-a4b9297a34a2)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdaa5a0e-5f3f-4488-86ea-b0d59e77107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdaa5a0e-5f3f-4488-86ea-b0d59e77107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd922a31-b448-4d02-899b-db1c8d21b2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd922a31-b448-4d02-899b-db1c8d21b2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216', 'volume_name': 'volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89439251-c341-4016-9d6d-5e02059a85e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89439251-c341-4016-9d6d-5e02059a85e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97781a0-3ed2-4726-932d-f9466bd43dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:14 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Volume 15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216', 'volume_size': 1} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:14 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d" returned: 0 in 0.687s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:57:14 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Converted 1024.00 MB image at 467.04 MB/s Apr 17 15:57:14 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:14 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 Apr 17 15:57:14 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:14 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708" returned: 0 in 0.409s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-32be63b0-6140-4812-9042-34f011afc708" released by "_copy_volume_from_snapshot" :: held 4.596s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd-32be63b0-6140-4812-9042-34f011afc708" released by "_create_volume_from_snapshot" :: held 4.633s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.668s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.068s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1892781495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a632e60d-483f-4873-bc1f-22376b07b591,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:09Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Creating volume a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:14 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:15 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 1073741824 Apr 17 15:57:15 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:15 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-dbbde0f5-1ab5-4169-902d-081d0204f833 tempest-GroupSnapshotsTest-969576532 None] Create group from source-snapshot-171cb335-e06a-4ad4-a51c-e50dc70ef811 completed successfully. Apr 17 15:57:15 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 1073741824" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:15 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 Apr 17 15:57:15 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:15 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591" returned: 0 in 0.438s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.866s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Creating offline snapshot 4345eb34-0c24-4e58-8f81-10f63755c8b4 of volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Attempting download of cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume a632e60d-483f-4873-bc1f-22376b07b591. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 15:57:15 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d383b0-c42e-4e2d-bcdb-bd33eeba6ede]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f5aa62-6263-4711-918c-a1bddcf7c923]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_6y3qyu0l {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:16 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 Apr 17 15:57:16 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:16 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_6y3qyu0l Apr 17 15:57:16 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-32be63b0-6140-4812-9042-34f011afc708" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-32be63b0-6140-4812-9042-34f011afc708" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4794e-80ac-4684-bfe1-6a0df5a1a479]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:16 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 Apr 17 15:57:16 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:16 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_6y3qyu0l" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_6y3qyu0l {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:16 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" returned: 0 in 0.572s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:16 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 1G Apr 17 15:57:16 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:16 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_6y3qyu0l Apr 17 15:57:16 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:16 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708" returned: 0 in 0.503s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:16 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708 Apr 17 15:57:16 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:17 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_6y3qyu0l" returned: 1 in 0.532s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1_6y3qyu0l' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20b8c41-3770-4fe1-ab66-522a71d37752]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:17 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 1G" returned: 0 in 0.532s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:17 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 Apr 17 15:57:17 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:17 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD Apr 17 15:57:17 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:17 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-32be63b0-6140-4812-9042-34f011afc708" returned: 0 in 0.459s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-32be63b0-6140-4812-9042-34f011afc708" released by "delete_volume" :: held 0.997s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Created reservations ['0c0dbf3f-bca7-41fb-934b-165e2f46d744'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:17 devstack cinder-volume[81996]: WARNING cinder.quota [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-561767972 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-561767972, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:17 devstack cinder-volume[81996]: WARNING cinder.quota [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-561767972 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-561767972, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Created reservations ['58f0c62f-2cbe-4561-9a73-ecc3a5fa28ba', '0415cbb3-a864-42d1-bca5-9f7bf5abce47', '65de6956-43c4-4a4a-8ec6-8c6c7864289d', '12576cb0-1da1-4575-aaea-2d1c5bafe57b'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:17 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:17 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:17 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4" returned: 0 in 0.455s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:17 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 is being set with open permissions: ugo+rw Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:17 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] cc5467f8-7dfc-439a-a775-b07f14ef45d1 was qcow2, converting to raw {{(pid=81996) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:17 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 Apr 17 15:57:17 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:17 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 Apr 17 15:57:17 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:17 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.435s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:17 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a4847681-3153-418e-b109-f5c6f85ec64d tempest-GroupSnapshotsTest-969576532 None] Delete group completed successfully. Apr 17 15:57:18 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4" returned: 0 in 0.442s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.620s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-174361735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58551001a7a41558ec321452b344b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:14Z,use_quota=True,user_id='b660f064016444c88bc3ebf3d4a49b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84361632-49ee-4684-b25e-a4b9297a34a2),volume_type_id=84361632-49ee-4684-b25e-a4b9297a34a2)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Creating volume 15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:18 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1c4e21b1-51c6-4352-a042-c1046da1c224 tempest-VolumesSnapshotListTestJSON-1485067724 None] Create snapshot completed successfully Apr 17 15:57:18 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 1073741824 Apr 17 15:57:18 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] group_snapshot 171cb335-e06a-4ad4-a51c-e50dc70ef811: deleting Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] group_snapshot 171cb335-e06a-4ad4-a51c-e50dc70ef811: deleting {{(pid=81996) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-a470d089-fc48-4522-8311-3ce6481e2b2d" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a470d089-fc48-4522-8311-3ce6481e2b2d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Deleting offline snapshot 4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd of volume a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] snapshot_file for this snap is: volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209817c-dd1c-4879-96b1-3922af35a61e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:18 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd Apr 17 15:57:18 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:18 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591" returned: 0 in 1.043s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ljgs3wnhdevstack@QuobyteHD, size 112.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:57:18 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Converted 112.00 MB image at 107.17 MB/s Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:18 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 1G Apr 17 15:57:18 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:18 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 1073741824" returned: 0 in 0.692s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:18 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 Apr 17 15:57:18 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:19 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" returned: 0 in 0.562s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a470d089-fc48-4522-8311-3ce6481e2b2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2850f7a-e1b3-41a7-9b66-7522583afd3c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:19 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 1G" returned: 0 in 0.532s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:19 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9575d3-0e1b-486d-90d9-9735f2423119]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:19 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:19 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 Apr 17 15:57:19 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:19 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216" returned: 0 in 0.511s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97781a0-3ed2-4726-932d-f9466bd43dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc980100-ebc2-49fe-a55e-0a4d7a2b9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:19 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Volume volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 (15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216): created successfully Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc980100-ebc2-49fe-a55e-0a4d7a2b9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Flow 'volume_create_manager' (9446ba0e-bee2-4f0d-a726-ac108f53afbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:19 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-01788817-7968-46e6-b95c-010e70a7cab0 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Created volume successfully. Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-4345eb34-0c24-4e58-8f81-10f63755c8b4-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-4345eb34-0c24-4e58-8f81-10f63755c8b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-quobyte-4345eb34-0c24-4e58-8f81-10f63755c8b4" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-4345eb34-0c24-4e58-8f81-10f63755c8b4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Deleting offline snapshot 4345eb34-0c24-4e58-8f81-10f63755c8b4 of volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] snapshot_file for this snap is: volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e5d50-8e59-4ff4-974e-8b1680275c15]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:19 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 Apr 17 15:57:19 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:19 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d" returned: 0 in 0.581s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:19 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591" returned: 0 in 0.519s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:19 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd Apr 17 15:57:19 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:19 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 Apr 17 15:57:19 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:19 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:19 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:20 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4" returned: 0 in 0.520s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80d06a-2f4a-43ec-b4de-8188fe50c8e4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:20 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" returned: 0 in 0.518s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:20 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 Apr 17 15:57:20 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:20 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd Apr 17 15:57:20 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:20 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591" returned: 1 in 0.577s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Downloaded image cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume a632e60d-483f-4873-bc1f-22376b07b591 successfully. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 for user e0b3c179791949ac8a6324dbe9bab351 is deleted. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Marking volume a632e60d-483f-4873-bc1f-22376b07b591 as bootable. {{(pid=81996) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Copying metadata from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 to a632e60d-483f-4873-bc1f-22376b07b591. {{(pid=81996) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Creating volume glance metadata for volume a632e60d-483f-4873-bc1f-22376b07b591 backed by image cc5467f8-7dfc-439a-a775-b07f14ef45d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81996) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab73b2d-07f3-4e36-8f65-e682be147bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a632e60d-483f-4873-bc1f-22376b07b591', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40069474-3261-41ea-8970-bfe6214c0c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:20 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Volume volume-a632e60d-483f-4873-bc1f-22376b07b591 (a632e60d-483f-4873-bc1f-22376b07b591): created successfully Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40069474-3261-41ea-8970-bfe6214c0c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (7421ecc9-2a69-4541-95d8-8667dca89736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-022be10c-dc61-49e1-a6d2-e4e994db370d tempest-VolumesGetTest-313547832 None] Created volume successfully. Apr 17 15:57:20 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9b2af9a5-f8fc-4deb-9928-15c2fdbe2f75 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Retype volume completed successfully. Apr 17 15:57:20 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d.4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" returned: 0 in 0.440s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-4a7e5d80-1d0c-4029-8d6e-6b144f6f26cd" released by "_delete_snapshot" :: held 2.158s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a470d089-fc48-4522-8311-3ce6481e2b2d" released by "delete_snapshot" :: held 2.171s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:20 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:20 devstack cinder-volume[81996]: WARNING cinder.quota [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-561767972 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-561767972, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" returned: 0 in 0.586s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:20 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] Created reservations ['e53cf081-79b5-45de-9973-cb384ddac060', 'aabb481f-3a8b-494a-b2e7-f7a069a05d3f', '51d44416-bd2d-45c5-887f-b46c04bd7128', '3214724f-874a-40ac-af64-7e923159756d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:20 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 Apr 17 15:57:20 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7756242c-6ddc-40b2-aa27-aa52fe02fec0 tempest-GroupSnapshotsTest-969576532 None] group_snapshot 171cb335-e06a-4ad4-a51c-e50dc70ef811: deleted successfully Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Acquiring lock "cinder-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "cinder-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Acquiring lock "cinder-quobyte-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "cinder-quobyte-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b06a79-1c0d-4b08-ab92-9d77d3004e97]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:21 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4" returned: 0 in 0.592s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:21 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4 Apr 17 15:57:21 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:21 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 Apr 17 15:57:21 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (98e23d7b-3bf1-4a3d-8a73-bcdb1c2196a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2daa49-89ec-4a00-984f-b0c95106c494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2daa49-89ec-4a00-984f-b0c95106c494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1790417107',display_name='tempest-VolumesGetTest-Volume-1543486768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660e4d39-ac4a-4b96-9f0c-70364d38571c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:21Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fbc4fc-4930-48ad-82c9-b751a92cd8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fbc4fc-4930-48ad-82c9-b751a92cd8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7fb298-691d-4481-b0f2-7f8b83fbf487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7fb298-691d-4481-b0f2-7f8b83fbf487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660e4d39-ac4a-4b96-9f0c-70364d38571c', 'volume_name': 'volume-660e4d39-ac4a-4b96-9f0c-70364d38571c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c44fd0-29da-4a45-aef3-e6559571245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c44fd0-29da-4a45-aef3-e6559571245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d810703-ae35-43ad-aa9a-b0d0369d99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:21 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Volume 660e4d39-ac4a-4b96-9f0c-70364d38571c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660e4d39-ac4a-4b96-9f0c-70364d38571c', 'volume_size': 1} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1790417107',display_name='tempest-VolumesGetTest-Volume-1543486768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660e4d39-ac4a-4b96-9f0c-70364d38571c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055447a7b6b44d96a34e1defdaa1b7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:21Z,use_quota=True,user_id='e0b3c179791949ac8a6324dbe9bab351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Creating volume 660e4d39-ac4a-4b96-9f0c-70364d38571c {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:21 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:21 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c 1073741824 Apr 17 15:57:21 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:21 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4345eb34-0c24-4e58-8f81-10f63755c8b4" returned: 0 in 0.435s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-4345eb34-0c24-4e58-8f81-10f63755c8b4" released by "_delete_snapshot" :: held 2.198s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" released by "delete_snapshot" :: held 2.225s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Created reservations ['d150a31d-980a-48ff-b7e1-5b5e722ce35a', 'adafd3ff-ffda-42a7-ad61-8829350c04ae', 'f177adc0-e814-42b4-8815-c5a36afbbc59', '8f727150-e5d9-4cd7-9795-8b394c0ba9cb'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:21 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Delete snapshot completed successfully. Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-afecb13b-d926-4474-8a09-e74e3539f77f tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-4345eb34-0c24-4e58-8f81-10f63755c8b4-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-a470d089-fc48-4522-8311-3ce6481e2b2d" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a470d089-fc48-4522-8311-3ce6481e2b2d" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de251b9-827a-45fc-b5a9-aa2d818c7743]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:21 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216" returned: 0 in 0.634s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:21 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216 Apr 17 15:57:21 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:21 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d Apr 17 15:57:21 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:22 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c 1073741824" returned: 0 in 0.558s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:22 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c Apr 17 15:57:22 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:22 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "cinder-quobyte-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216" released by "delete_volume" :: held 1.154s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:22 devstack cinder-volume[81996]: WARNING cinder.quota [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:22 devstack cinder-volume[81996]: WARNING cinder.quota [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:22 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d" returned: 0 in 0.539s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Created reservations ['fd3108e2-4a52-4d84-a1a4-07e460c3e7bc', 'f45e774a-3e02-454b-a089-cec5796e74da', '2ef00e5e-bcf2-42cc-abeb-5a542aaad76d', '03c73f0c-a5fb-4fe4-9a65-e8ecea937938'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:22 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d Apr 17 15:57:22 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:22 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c" returned: 0 in 0.468s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:22 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:22 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d810703-ae35-43ad-aa9a-b0d0369d99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660e4d39-ac4a-4b96-9f0c-70364d38571c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890757dc-d82d-4588-ac33-678f49f54a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:22 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Volume volume-660e4d39-ac4a-4b96-9f0c-70364d38571c (660e4d39-ac4a-4b96-9f0c-70364d38571c): created successfully Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890757dc-d82d-4588-ac33-678f49f54a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Flow 'volume_create_manager' (98e23d7b-3bf1-4a3d-8a73-bcdb1c2196a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:22 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-673e8da2-8d97-49ae-8950-734684850fec tempest-VolumesGetTest-313547832 None] Created volume successfully. Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-6a295e55-fc4a-4be6-89d0-21d8fd5d6e68-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-6a295e55-fc4a-4be6-89d0-21d8fd5d6e68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-quobyte-6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Deleting offline snapshot 6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 of volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] snapshot_file for this snap is: volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb552d8-1752-44d1-b567-5abf1df2c62b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:22 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 Apr 17 15:57:22 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:22 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a470d089-fc48-4522-8311-3ce6481e2b2d" returned: 0 in 0.442s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a470d089-fc48-4522-8311-3ce6481e2b2d" released by "delete_volume" :: held 1.009s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Created reservations ['e37b216f-9520-48a7-843a-c17a563db959'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:22 devstack cinder-volume[81996]: WARNING cinder.db.sqlalchemy.api [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-561767972'] Apr 17 15:57:22 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Created reservations ['5a565804-1203-48c6-baf2-11bae01d261b', 'a740d55f-1a38-4004-a3c4-c1b3b7cbb294', '1ff31165-9af7-4dbb-b79d-81833623814d', 'd5ec3346-7d37-40bd-bba5-df5407b7d7d3'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:22 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:22 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Deleted volume successfully. Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-263eb18e-f61a-4e90-bda0-502b1e8643f6 tempest-VolumeRetypeWithoutMigrationTest-1332433894 None] Lock "cinder-15f4ac66-c0e6-4c28-b4d7-0a77ffb8d216-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:23 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:23 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:23 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" returned: 0 in 0.525s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98756c0-5b69-491f-ac4c-a81970a6666c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:23 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 Apr 17 15:57:23 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:23 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:23 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f0991835-4e09-41b2-ac2b-1c10ddef9dea tempest-GroupSnapshotsTest-969576532 None] Delete group completed successfully. Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-660e4d39-ac4a-4b96-9f0c-70364d38571c-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Lock "cinder-660e4d39-ac4a-4b96-9f0c-70364d38571c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-660e4d39-ac4a-4b96-9f0c-70364d38571c" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-660e4d39-ac4a-4b96-9f0c-70364d38571c" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca852a2-2dab-470f-9092-bcee30d58269]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:23 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c Apr 17 15:57:23 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:23 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7" returned: 0 in 0.650s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:23 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 Apr 17 15:57:23 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:24 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c" returned: 0 in 0.553s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:24 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c Apr 17 15:57:24 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-618892cf-1f7a-4dfa-b3d1-36a2daf01c48 tempest-GroupSnapshotsTest-969576532 None] Group tempest-GroupSnapshotsTest-Group-892981841: creating Apr 17 15:57:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-618892cf-1f7a-4dfa-b3d1-36a2daf01c48 tempest-GroupSnapshotsTest-969576532 None] Group tempest-GroupSnapshotsTest-Group-892981841: created successfully Apr 17 15:57:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-618892cf-1f7a-4dfa-b3d1-36a2daf01c48 tempest-GroupSnapshotsTest-969576532 None] Create group completed successfully. Apr 17 15:57:24 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" returned: 0 in 0.695s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:24 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68 Apr 17 15:57:24 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:24 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-660e4d39-ac4a-4b96-9f0c-70364d38571c" returned: 0 in 0.563s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-660e4d39-ac4a-4b96-9f0c-70364d38571c" released by "delete_volume" :: held 1.150s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Created reservations ['d56010f6-30ca-40c6-acbd-72645fa188d1', '40e6786b-b0e0-41b6-8fbd-ff356d393929', '5f2e56cc-649d-412a-ace3-e657705e8633', 'd01a8d78-3fb4-456c-a3a4-f968c103d59e'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:24 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:24 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:25 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-6a295e55-fc4a-4be6-89d0-21d8fd5d6e68" released by "_delete_snapshot" :: held 2.404s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" released by "delete_snapshot" :: held 2.416s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Created reservations ['b7f475e6-9292-462f-83b6-7c53e9c10a42', 'd456bcd9-3190-48c0-9d34-bc6f15d892cf', '816c40a9-0adc-420d-ad64-2563036ba1f0', '18ca33aa-4678-480a-b98b-e16b541e9c45'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:25 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Delete snapshot completed successfully. Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2ebec1a1-d321-46c7-9bdc-8044cf75ffb4 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-6a295e55-fc4a-4be6-89d0-21d8fd5d6e68-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:25 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:25 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Deleted volume successfully. Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ccb100d0-13aa-46b5-ad31-38a06c086401 tempest-VolumesGetTest-313547832 None] Lock "cinder-660e4d39-ac4a-4b96-9f0c-70364d38571c-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (477afd41-d65e-4644-be39-0fd97c16db54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a9ce75-f9c5-421d-af48-9420386ce180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a9ce75-f9c5-421d-af48-9420386ce180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504534653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2b020e6-3042-42a7-bf27-fad8bfd84905,host='devstack@QuobyteHD#QuobyteHD',id=25f3880b-c608-450d-ae37-f2206c28a2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:26Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6b7b16b-57ac-4299-a2bb-f151123389c4),volume_type_id=e6b7b16b-57ac-4299-a2bb-f151123389c4)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d548732-a812-40cc-ac83-c5864618f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d548732-a812-40cc-ac83-c5864618f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc741c93-c6ef-4095-8a49-61f13ab9633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc741c93-c6ef-4095-8a49-61f13ab9633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f3880b-c608-450d-ae37-f2206c28a2f2', 'volume_name': 'volume-25f3880b-c608-450d-ae37-f2206c28a2f2', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16961c3-9e2c-4068-bd4f-0f1b5f10e262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16961c3-9e2c-4068-bd4f-0f1b5f10e262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6c70d0-c6bf-4c89-aa4a-22ff61b7ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:25 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Volume 25f3880b-c608-450d-ae37-f2206c28a2f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f3880b-c608-450d-ae37-f2206c28a2f2', 'volume_size': 1} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2b020e6-3042-42a7-bf27-fad8bfd84905,created_at=2026-04-17T13:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504534653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2b020e6-3042-42a7-bf27-fad8bfd84905,host='devstack@QuobyteHD#QuobyteHD',id=25f3880b-c608-450d-ae37-f2206c28a2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:26Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6b7b16b-57ac-4299-a2bb-f151123389c4),volume_type_id=e6b7b16b-57ac-4299-a2bb-f151123389c4)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Creating volume 25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:25 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-4a3ccd62-052c-4223-888c-3c8b30fb74e7-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:25 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 1073741824 Apr 17 15:57:25 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-a632e60d-483f-4873-bc1f-22376b07b591-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Lock "cinder-a632e60d-483f-4873-bc1f-22376b07b591-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-4a3ccd62-052c-4223-888c-3c8b30fb74e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-quobyte-4a3ccd62-052c-4223-888c-3c8b30fb74e7" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-4a3ccd62-052c-4223-888c-3c8b30fb74e7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Deleting offline snapshot 4a3ccd62-052c-4223-888c-3c8b30fb74e7 of volume 1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] snapshot_file for this snap is: volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:25 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e7eb6f-1224-4dda-9769-ca72b4e5b23e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Acquiring lock "cinder-quobyte-a632e60d-483f-4873-bc1f-22376b07b591" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-a632e60d-483f-4873-bc1f-22376b07b591" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d96e71-a034-43e5-9166-f88be5bca93f]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:26 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 Apr 17 15:57:26 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:26 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 Apr 17 15:57:26 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:26 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 1073741824" returned: 0 in 0.561s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:26 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 Apr 17 15:57:26 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:26 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7" returned: 0 in 0.591s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[63403a63-8ef0-4d8c-b898-6940952cd692]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:26 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591" returned: 0 in 0.594s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:26 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c Apr 17 15:57:26 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:26 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 Apr 17 15:57:26 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Flow 'volume_create_manager' (cf68366c-b463-4747-abaa-cdfc7a5a3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135afeaf-16f7-416c-8998-0ad3d946f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135afeaf-16f7-416c-8998-0ad3d946f03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-326402419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f9eacc-b84e-41c8-a459-0b7b01904912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ea2933f9a347bcab67eb004609aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:27Z,use_quota=True,user_id='82fb73f2d2e24f9f98a05bc113b2955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dced3b-a94d-466b-b397-a3409dcef947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dced3b-a94d-466b-b397-a3409dcef947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd19a053-3d94-4643-bc8d-023cbd83d994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd19a053-3d94-4643-bc8d-023cbd83d994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f9eacc-b84e-41c8-a459-0b7b01904912', 'volume_name': 'volume-a5f9eacc-b84e-41c8-a459-0b7b01904912', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183c9f05-e771-4d5a-b8cb-06d1f26fd66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183c9f05-e771-4d5a-b8cb-06d1f26fd66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a39108b-38cf-4812-9cbd-593ae8914c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:27 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Volume a5f9eacc-b84e-41c8-a459-0b7b01904912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f9eacc-b84e-41c8-a459-0b7b01904912', 'volume_size': 1} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:27 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2" returned: 0 in 0.524s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-326402419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f9eacc-b84e-41c8-a459-0b7b01904912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ea2933f9a347bcab67eb004609aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:27Z,use_quota=True,user_id='82fb73f2d2e24f9f98a05bc113b2955d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Creating volume a5f9eacc-b84e-41c8-a459-0b7b01904912 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:27 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6c70d0-c6bf-4c89-aa4a-22ff61b7ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f3880b-c608-450d-ae37-f2206c28a2f2', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:27 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 1073741824 Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8674d911-5ae2-4005-a781-013e2e24be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:27 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:27 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Volume volume-25f3880b-c608-450d-ae37-f2206c28a2f2 (25f3880b-c608-450d-ae37-f2206c28a2f2): created successfully Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8674d911-5ae2-4005-a781-013e2e24be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (477afd41-d65e-4644-be39-0fd97c16db54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:27 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-431d1289-805d-411b-a899-dc130c46484c tempest-GroupSnapshotsTest-969576532 None] Created volume successfully. Apr 17 15:57:27 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" returned: 0 in 0.552s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:27 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 Apr 17 15:57:27 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:27 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591" returned: 1 in 0.609s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:27 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591 Apr 17 15:57:27 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:27 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 1073741824" returned: 0 in 0.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:27 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 Apr 17 15:57:27 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:27 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7" returned: 0 in 0.496s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:27 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7 Apr 17 15:57:27 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:27 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a632e60d-483f-4873-bc1f-22376b07b591" returned: 0 in 0.420s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Lock "cinder-quobyte-a632e60d-483f-4873-bc1f-22376b07b591" released by "delete_volume" :: held 1.665s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Created reservations ['c039c0e5-de03-4789-9afc-1f08775f8fd9', 'd56404f4-ee21-4fca-b91c-71c4d3e152e2', '67507a22-cf3d-44fe-aff8-b193dca807fb', '9e1aa4a7-3fa8-422d-9965-d07681a96060'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:27 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:27 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:28 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912" returned: 0 in 0.480s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a39108b-38cf-4812-9cbd-593ae8914c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f9eacc-b84e-41c8-a459-0b7b01904912', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82f7e62-6b57-4b43-8e52-a483a218825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:28 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Volume volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 (a5f9eacc-b84e-41c8-a459-0b7b01904912): created successfully Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82f7e62-6b57-4b43-8e52-a483a218825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Flow 'volume_create_manager' (cf68366c-b463-4747-abaa-cdfc7a5a3df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:28 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-62384805-d813-43c9-b231-573d38c22612 tempest-VolumesServicesTestJSON-1539813579 None] Created volume successfully. Apr 17 15:57:28 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c.4a3ccd62-052c-4223-888c-3c8b30fb74e7" returned: 0 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-4a3ccd62-052c-4223-888c-3c8b30fb74e7" released by "_delete_snapshot" :: held 2.189s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" released by "delete_snapshot" :: held 2.209s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Created reservations ['a24784ae-421d-4d3c-a5cf-3655276b5b75', '4d20d92d-0ba8-403f-bea5-d860669c2a6d', 'c9ed0587-aafc-4a42-8047-fbce5b089924', 'ddb08243-8687-43df-91e0-46b91d52f14d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:28 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.461s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:28 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Deleted volume successfully. Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7846798-a6a4-471e-8e75-e2f7f4577bf5 tempest-VolumesGetTest-313547832 None] Lock "cinder-a632e60d-483f-4873-bc1f-22376b07b591-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:28 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Delete snapshot completed successfully. Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4db0a466-54f6-43e4-867c-666a7a7b5e20 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-4a3ccd62-052c-4223-888c-3c8b30fb74e7-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (582ccd69-2718-4c0e-9c34-6c7e042d9713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d02eb-ff3f-406c-9897-99ea563175e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d02eb-ff3f-406c-9897-99ea563175e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-15704017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2b020e6-3042-42a7-bf27-fad8bfd84905,host='devstack@QuobyteHD#QuobyteHD',id=a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:28Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6b7b16b-57ac-4299-a2bb-f151123389c4),volume_type_id=e6b7b16b-57ac-4299-a2bb-f151123389c4)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f85f34-aa56-4620-89fc-d4dbf6809eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f85f34-aa56-4620-89fc-d4dbf6809eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03285553-9dd9-4688-a88f-e14d9da9728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03285553-9dd9-4688-a88f-e14d9da9728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb', 'volume_name': 'volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72417379-a419-44cc-905a-d63a6313b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72417379-a419-44cc-905a-d63a6313b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dda18b-c3f8-4cbe-a550-63a55a1461e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:28 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Volume a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb', 'volume_size': 1} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2b020e6-3042-42a7-bf27-fad8bfd84905,created_at=2026-04-17T13:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-15704017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2b020e6-3042-42a7-bf27-fad8bfd84905,host='devstack@QuobyteHD#QuobyteHD',id=a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:28Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6b7b16b-57ac-4299-a2bb-f151123389c4),volume_type_id=e6b7b16b-57ac-4299-a2bb-f151123389c4)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Creating volume a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:28 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:28 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb 1073741824 Apr 17 15:57:28 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:29 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb 1073741824" returned: 0 in 0.574s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:29 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb Apr 17 15:57:29 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3e66dc-1b52-4d83-8471-eac2f32d4972]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Acquiring lock "cinder-a5f9eacc-b84e-41c8-a459-0b7b01904912-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Lock "cinder-a5f9eacc-b84e-41c8-a459-0b7b01904912-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Acquiring lock "cinder-quobyte-a5f9eacc-b84e-41c8-a459-0b7b01904912" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Lock "cinder-quobyte-a5f9eacc-b84e-41c8-a459-0b7b01904912" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca627a-3da2-4afd-a1c3-b26cab776847]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:29 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c Apr 17 15:57:29 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:29 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 Apr 17 15:57:29 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:29 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" returned: 0 in 0.646s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dda18b-c3f8-4cbe-a550-63a55a1461e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f0c1de-980a-4a8f-8399-68164a579b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Volume volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb (a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb): created successfully Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f0c1de-980a-4a8f-8399-68164a579b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (582ccd69-2718-4c0e-9c34-6c7e042d9713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-476ec3fb-fdd5-485f-b8ab-ecd5b7446328 tempest-GroupSnapshotsTest-969576532 None] Created volume successfully. Apr 17 15:57:29 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" returned: 0 in 0.591s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:29 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c Apr 17 15:57:29 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:29 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912" returned: 0 in 0.609s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:29 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912 Apr 17 15:57:29 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:29 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (9e216bef-5554-4e82-99e7-a50a8052a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdf6f3f-17d4-4306-9349-d6532d6e7a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdf6f3f-17d4-4306-9349-d6532d6e7a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-159209434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e38115-78a7-4deb-8746-6705ea521e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:30Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06f6d64-aa81-4abb-b314-c12277e04fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06f6d64-aa81-4abb-b314-c12277e04fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f99f465-6902-4369-af3b-ef45c21dc380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f99f465-6902-4369-af3b-ef45c21dc380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e38115-78a7-4deb-8746-6705ea521e41', 'volume_name': 'volume-85e38115-78a7-4deb-8746-6705ea521e41', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c0fc4d-87f9-4f78-b592-bf436cadf659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c0fc4d-87f9-4f78-b592-bf436cadf659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d605fc-f77b-4b44-938b-2ccec4af85c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:30 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume 85e38115-78a7-4deb-8746-6705ea521e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e38115-78a7-4deb-8746-6705ea521e41', 'volume_size': 1} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-159209434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e38115-78a7-4deb-8746-6705ea521e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:30Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Creating volume 85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:30 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:30 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 1073741824 Apr 17 15:57:30 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:30 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-quobyte-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c" released by "delete_volume" :: held 1.130s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Created reservations ['1af3a6b4-4261-4005-a1ec-23519886f30b', '97210ea1-7054-455f-a01c-a69f6cd3328b', 'f7da4280-c9b8-4a19-8916-ba119de3f505', '24abb24c-a8e5-4569-8ec0-bf7b49fd1a1f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:30 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a5f9eacc-b84e-41c8-a459-0b7b01904912" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Lock "cinder-quobyte-a5f9eacc-b84e-41c8-a459-0b7b01904912" released by "delete_volume" :: held 1.140s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:30 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:30 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Created reservations ['8dfe71a1-bd18-4425-9e66-734d42ed62d5', 'fb262652-4555-42cb-8154-71d93045dbb5', '712b289e-7187-4e37-b8ca-61ab81bb09b7', '9bfaa239-9cd0-4791-9d5d-788a849e51ed'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:30 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:30 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:30 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 1073741824" returned: 0 in 0.593s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:30 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 Apr 17 15:57:30 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:30 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-bd9668b5-3346-4126-8ca0-ea1c6799feed tempest-GroupSnapshotsTest-969576532 None] Update group completed successfully. Apr 17 15:57:30 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:30 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Deleted volume successfully. Apr 17 15:57:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d303d61c-937f-4c5b-bf94-307005ee4309 tempest-VolumesSnapshotListTestJSON-1485067724 None] Lock "cinder-1a66bf3b-6c86-48ab-9a71-53d537f1dd9c-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:31 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.476s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:31 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Deleted volume successfully. Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4f4224d6-bb1e-4993-a550-c58b2b046956 tempest-VolumesServicesTestJSON-1539813579 None] Lock "cinder-a5f9eacc-b84e-41c8-a459-0b7b01904912-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:31 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41" returned: 0 in 0.475s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d605fc-f77b-4b44-938b-2ccec4af85c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e38115-78a7-4deb-8746-6705ea521e41', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9596858a-3486-43bf-be71-3270b57c3e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:31 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume volume-85e38115-78a7-4deb-8746-6705ea521e41 (85e38115-78a7-4deb-8746-6705ea521e41): created successfully Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9596858a-3486-43bf-be71-3270b57c3e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (9e216bef-5554-4e82-99e7-a50a8052a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:31 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-af09f539-8cb0-42bb-a1de-2fa86452dfbb tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created volume successfully. Apr 17 15:57:31 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-5133d4df-c7ba-49ea-a4be-7efb859efe80 tempest-GroupSnapshotsTest-969576532 None] Update group completed successfully. Apr 17 15:57:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:32 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Creating offline snapshot a7a74176-04d1-4234-9e67-90dc8a00fed0 of volume 85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:32 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdcd342-9f14-40f1-8dcf-e1cfb611d3ec]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:32 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 Apr 17 15:57:32 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:32 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41" returned: 0 in 0.664s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:32 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 1G Apr 17 15:57:32 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-efc8ecb6-629f-4c9e-a3db-84bf3339ce26 tempest-GroupSnapshotsTest-969576532 None] Update group completed successfully. Apr 17 15:57:33 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 1G" returned: 0 in 0.553s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e38115-78a7-4deb-8746-6705ea521e41 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:33 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e38115-78a7-4deb-8746-6705ea521e41 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 Apr 17 15:57:33 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Flow 'volume_create_manager' (05005e86-8657-4557-ad46-09fad787aa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017eb403-64d6-4444-ab2b-cc4510e940c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017eb403-64d6-4444-ab2b-cc4510e940c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-304382062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c3ce33-bd4a-42fe-bbdf-f2824743f17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f10f88642ba471d998d5f1f22eb800b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:34Z,use_quota=True,user_id='5dbe899ed9ff40d0985193daac04c6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7c8564-3995-4c0e-bc7e-2dd579f13efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7c8564-3995-4c0e-bc7e-2dd579f13efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0122470b-37ba-490c-b701-7edea0443ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0122470b-37ba-490c-b701-7edea0443ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c3ce33-bd4a-42fe-bbdf-f2824743f17f', 'volume_name': 'volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f', 'volume_size': 2}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318ba33-3e64-4b02-8bfc-bdfa8a583335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318ba33-3e64-4b02-8bfc-bdfa8a583335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4eb80f-43fb-47bb-ba6f-f7f8a222d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:33 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Volume 21c3ce33-bd4a-42fe-bbdf-f2824743f17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f', 'volume_size': 2} Apr 17 15:57:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:34 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e38115-78a7-4deb-8746-6705ea521e41 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0" returned: 0 in 0.527s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:34 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 is being set with open permissions: ugo+rw Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:34 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 Apr 17 15:57:34 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-c5b2ba45-02dd-4635-ae9a-e64d12ff1806 tempest-GroupSnapshotsTest-969576532 None] Update group completed successfully. Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:34 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:34 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:34 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0" returned: 0 in 0.499s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:34 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.info Apr 17 15:57:34 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:34 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.459s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Flow 'volume_create_manager' (139fb4a5-8239-486d-9402-06d4fefd5334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9435653-f7de-479c-beae-94d0774b97bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:35 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9435653-f7de-479c-beae-94d0774b97bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1499496763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244de2e3-05d7-4d9d-8728-0257f33170b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3756ab15e81942d393b7c4bcb266742b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:35Z,use_quota=True,user_id='ecedd13045114cc39d7be2d84d5ab9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d5db16-5696-4d46-9ed4-871d7dd77330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d5db16-5696-4d46-9ed4-871d7dd77330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d1e5c1-daea-458d-871f-83b6a80d2ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d1e5c1-daea-458d-871f-83b6a80d2ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244de2e3-05d7-4d9d-8728-0257f33170b1', 'volume_name': 'volume-244de2e3-05d7-4d9d-8728-0257f33170b1', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82205d34-b903-4de9-8727-9bcafb4fd288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82205d34-b903-4de9-8727-9bcafb4fd288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362a9b43-1c5d-4842-be0d-ececd0016f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:35 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Volume 244de2e3-05d7-4d9d-8728-0257f33170b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244de2e3-05d7-4d9d-8728-0257f33170b1', 'volume_size': 1} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.info" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:35 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.info is being set with open permissions: ugo+rw Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:35 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.info Apr 17 15:57:35 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] GroupSnapshot cf573051-3f7d-4410-876c-a2a79a673fb6: creating. Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Group snapshot cf573051-3f7d-4410-876c-a2a79a673fb6: creating. {{(pid=81996) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:35 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.info" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-304382062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c3ce33-bd4a-42fe-bbdf-f2824743f17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f10f88642ba471d998d5f1f22eb800b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:34Z,use_quota=True,user_id='5dbe899ed9ff40d0985193daac04c6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Creating volume 21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:35 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f 2147483648 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:35 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f 2147483648 Apr 17 15:57:35 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-c6f02fbc-5514-4942-99de-4376290f56ea tempest-CreateVolumesFromSnapshotTest-1122419679 None] Create snapshot completed successfully Apr 17 15:57:36 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f 2147483648" returned: 0 in 0.500s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:36 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f Apr 17 15:57:36 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:36 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" returned: 0 in 0.406s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1499496763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244de2e3-05d7-4d9d-8728-0257f33170b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3756ab15e81942d393b7c4bcb266742b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:35Z,use_quota=True,user_id='ecedd13045114cc39d7be2d84d5ab9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Creating volume 244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:36 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4eb80f-43fb-47bb-ba6f-f7f8a222d963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f', 'volume_size': 2}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0f2181-e4b9-4e44-af61-33737cdd490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 1073741824 Apr 17 15:57:36 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:36 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Volume volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f (21c3ce33-bd4a-42fe-bbdf-f2824743f17f): created successfully Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0f2181-e4b9-4e44-af61-33737cdd490c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Flow 'volume_create_manager' (05005e86-8657-4557-ad46-09fad787aa56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ab78501d-da0d-4615-b012-22d0468992c3 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Created volume successfully. Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (baddc0a8-bd88-48ba-b541-785f474c6272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410e914d-e2d9-422b-8616-5c0b3ea53b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410e914d-e2d9-422b-8616-5c0b3ea53b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839843945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110ab3fd-a6f5-4f4d-91e6-767189b4647b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a6a028-6b47-48a1-8861-aa82ffb68701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a6a028-6b47-48a1-8861-aa82ffb68701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2001f71-d50b-40f3-8031-14a852b39351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2001f71-d50b-40f3-8031-14a852b39351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110ab3fd-a6f5-4f4d-91e6-767189b4647b', 'volume_name': 'volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b6868a-089d-4483-bc30-1e31aa80aeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b6868a-089d-4483-bc30-1e31aa80aeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766ee630-68ad-4d20-b5c6-0797db312dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume 110ab3fd-a6f5-4f4d-91e6-767189b4647b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b', 'volume_size': 1} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (24d49138-cbc2-4ada-aaa4-92da535e7781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7988a7-f8b5-4503-9895-fe95e6f39fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7988a7-f8b5-4503-9895-fe95e6f39fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-497165310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0682259-3512-4264-b16e-556f98d82ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bcf336-727c-49a9-92f7-ae0a7f8f445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bcf336-727c-49a9-92f7-ae0a7f8f445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d757613c-0665-4777-bb84-2ae77dcdb856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d757613c-0665-4777-bb84-2ae77dcdb856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0682259-3512-4264-b16e-556f98d82ab5', 'volume_name': 'volume-b0682259-3512-4264-b16e-556f98d82ab5', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4372d24-d587-4542-a8e2-770f8cebe6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4372d24-d587-4542-a8e2-770f8cebe6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab37d803-e9ef-4398-8b29-1b6d46b0bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:36 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume b0682259-3512-4264-b16e-556f98d82ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0682259-3512-4264-b16e-556f98d82ab5', 'volume_size': 1} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (ed0a6fa7-a75a-4045-aca3-c88d9b7dd0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c8f1d7-ddfc-4474-94e5-e807e5c0e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c8f1d7-ddfc-4474-94e5-e807e5c0e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1851520992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858f9660-3926-4d77-a473-ac7afb2ac014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215f0284-542d-4e6e-8177-962224b46094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215f0284-542d-4e6e-8177-962224b46094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705edf35-c08d-4618-ae29-e7b58d17e3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705edf35-c08d-4618-ae29-e7b58d17e3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858f9660-3926-4d77-a473-ac7afb2ac014', 'volume_name': 'volume-858f9660-3926-4d77-a473-ac7afb2ac014', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69654434-2113-4d77-af3d-1e6283d11847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69654434-2113-4d77-af3d-1e6283d11847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c5295-c9a2-493a-b9a3-db4512d98613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume 858f9660-3926-4d77-a473-ac7afb2ac014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858f9660-3926-4d77-a473-ac7afb2ac014', 'volume_size': 1} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:37 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 1073741824" returned: 0 in 0.653s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:37 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 Apr 17 15:57:37 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (fc5eff03-808c-433d-83bd-1063ae279fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1378bcce-fc39-4c62-a972-6f1e4e4f42b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1378bcce-fc39-4c62-a972-6f1e4e4f42b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490781106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6934ef-c4b1-40c4-be12-2cebe059b6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2158e48f-c730-4473-809f-3b00f6f904a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2158e48f-c730-4473-809f-3b00f6f904a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78befe5-e79e-4611-95b7-d9835a228c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78befe5-e79e-4611-95b7-d9835a228c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6934ef-c4b1-40c4-be12-2cebe059b6fe', 'volume_name': 'volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d59d3e1-767f-4f9b-b971-c99b1cca2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d59d3e1-767f-4f9b-b971-c99b1cca2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c618c3-ce3f-4b02-937a-5e074c0670aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume 0d6934ef-c4b1-40c4-be12-2cebe059b6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe', 'volume_size': 1} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (a57806ba-9557-4180-9f9f-81f6c6b3763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd6e354-66a8-4d08-a497-3a93108a3f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd6e354-66a8-4d08-a497-3a93108a3f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-282298191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fec951-3db4-4f47-ad3b-ec7624d63c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12aed4d-f464-4b8b-b5fa-990f730e604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12aed4d-f464-4b8b-b5fa-990f730e604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0216f66-42bf-4e1e-92fd-fef7f6f97d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0216f66-42bf-4e1e-92fd-fef7f6f97d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fec951-3db4-4f47-ad3b-ec7624d63c8b', 'volume_name': 'volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b392a4-dade-461d-a848-c3a7ebf2077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b392a4-dade-461d-a848-c3a7ebf2077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c8477b-d623-42d6-bcd3-adbe26367878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume f8fec951-3db4-4f47-ad3b-ec7624d63c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b', 'volume_size': 1} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:37 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1" returned: 0 in 0.452s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.243s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362a9b43-1c5d-4842-be0d-ececd0016f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244de2e3-05d7-4d9d-8728-0257f33170b1', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491c2c2a-2068-42d9-ba1d-a4907f806c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Creating offline snapshot 4be439cd-b05d-4d85-9d93-c3e8884de741 of volume a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:37 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Volume volume-244de2e3-05d7-4d9d-8728-0257f33170b1 (244de2e3-05d7-4d9d-8728-0257f33170b1): created successfully Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491c2c2a-2068-42d9-ba1d-a4907f806c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Flow 'volume_create_manager' (139fb4a5-8239-486d-9402-06d4fefd5334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0672bafb-a576-457b-9e35-e9b8d81cb44c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:37 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3668b6e1-516b-4351-91b4-33c8e84c454f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Created volume successfully. Apr 17 15:57:37 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb Apr 17 15:57:37 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:38 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:38 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 1G Apr 17 15:57:38 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:38 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 1G" returned: 0 in 0.481s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:38 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 Apr 17 15:57:38 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:39 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741" returned: 0 in 0.425s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:39 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:39 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 Apr 17 15:57:39 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:39 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741" returned: 0 in 0.420s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:39 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.info Apr 17 15:57:39 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:39 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.info" returned: 0 in 0.400s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:39 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:39 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.info Apr 17 15:57:39 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:40 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.info" returned: 0 in 0.415s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Creating offline snapshot 9654a8a5-be46-40e0-b438-b9dc9c48bcf4 of volume 25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eff284-96cc-4acb-a59f-8056cbd81565]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:40 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 Apr 17 15:57:40 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:40 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:40 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 1G Apr 17 15:57:40 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:41 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 1G" returned: 0 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f3880b-c608-450d-ae37-f2206c28a2f2 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:41 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f3880b-c608-450d-ae37-f2206c28a2f2 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 Apr 17 15:57:41 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:41 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f3880b-c608-450d-ae37-f2206c28a2f2 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4" returned: 0 in 0.424s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:41 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:41 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 Apr 17 15:57:41 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:42 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4" returned: 0 in 0.398s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:42 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.info Apr 17 15:57:42 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:42 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.info" returned: 0 in 0.409s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:42 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:42 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.info Apr 17 15:57:42 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:42 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.info" returned: 0 in 0.403s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.609s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.115s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-497165310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0682259-3512-4264-b16e-556f98d82ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Creating volume b0682259-3512-4264-b16e-556f98d82ab5 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:43 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:43 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 1073741824 Apr 17 15:57:43 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-966769ab-1796-4f15-949b-0cf2c6a36e61 tempest-GroupSnapshotsTest-969576532 None] group_snapshot cf573051-3f7d-4410-876c-a2a79a673fb6: created successfully Apr 17 15:57:43 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 1073741824" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:43 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 Apr 17 15:57:43 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] group_snapshot cf573051-3f7d-4410-876c-a2a79a673fb6: deleting Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] group_snapshot cf573051-3f7d-4410-876c-a2a79a673fb6: deleting {{(pid=81996) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-4be439cd-b05d-4d85-9d93-c3e8884de741" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-4be439cd-b05d-4d85-9d93-c3e8884de741" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Deleting offline snapshot 4be439cd-b05d-4d85-9d93-c3e8884de741 of volume a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] snapshot_file for this snap is: volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eddf1ce-cc31-4a2a-af28-bca6b81b9970]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:43 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 Apr 17 15:57:43 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:43 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.017s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab37d803-e9ef-4398-8b29-1b6d46b0bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0682259-3512-4264-b16e-556f98d82ab5', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704804cd-aac9-49c6-91d5-5de0cd082e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Creating offline snapshot d099dcf2-4a5b-49c2-b3ba-5414461adf86 of volume 21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:44 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume volume-b0682259-3512-4264-b16e-556f98d82ab5 (b0682259-3512-4264-b16e-556f98d82ab5): created successfully Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704804cd-aac9-49c6-91d5-5de0cd082e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (24d49138-cbc2-4ada-aaa4-92da535e7781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb93f32f-fd8d-4521-9fe7-819df8754828]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:44 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-726f64eb-f6a2-4137-8c9c-6b52ab06adf3 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created volume successfully. Apr 17 15:57:44 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f Apr 17 15:57:44 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:44 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741" returned: 0 in 0.497s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d5076-62ac-46d1-bfe6-ad4324236bc7]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:44 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb Apr 17 15:57:44 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:44 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" returned: 0 in 0.468s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 2G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:44 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 2G Apr 17 15:57:44 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:44 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" returned: 0 in 0.485s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:44 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 Apr 17 15:57:44 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:44 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 2G" returned: 0 in 0.480s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:45 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 Apr 17 15:57:45 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:45 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741" returned: 0 in 0.435s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:45 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741 Apr 17 15:57:45 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:45 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86" returned: 0 in 0.436s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:45 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 is being set with open permissions: ugo+rw Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:45 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 Apr 17 15:57:45 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:45 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb.4be439cd-b05d-4d85-9d93-c3e8884de741" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-4be439cd-b05d-4d85-9d93-c3e8884de741" released by "_delete_snapshot" :: held 1.901s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" released by "delete_snapshot" :: held 1.912s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-25f3880b-c608-450d-ae37-f2206c28a2f2" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-25f3880b-c608-450d-ae37-f2206c28a2f2" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-9654a8a5-be46-40e0-b438-b9dc9c48bcf4" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-9654a8a5-be46-40e0-b438-b9dc9c48bcf4" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Deleting offline snapshot 9654a8a5-be46-40e0-b438-b9dc9c48bcf4 of volume 25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] snapshot_file for this snap is: volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dd10e8-eec0-40e7-bf0b-9a07d86077bb]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:45 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86" returned: 0 in 0.412s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:45 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 Apr 17 15:57:45 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:45 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.info Apr 17 15:57:45 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:46 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.info" returned: 0 in 0.409s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:46 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.info is being set with open permissions: ugo+rw Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:46 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4" returned: 0 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f3880b-c608-450d-ae37-f2206c28a2f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:46 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.info Apr 17 15:57:46 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0c0d51-4290-45c6-a9e6-c03cf6085975]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:46 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 Apr 17 15:57:46 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:46 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.info" returned: 0 in 0.414s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.552s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1851520992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858f9660-3926-4d77-a473-ac7afb2ac014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Creating volume 858f9660-3926-4d77-a473-ac7afb2ac014 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:46 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:46 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 1073741824 Apr 17 15:57:46 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-12517002-efec-4426-bdf2-ad51a0fed514 tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Create snapshot completed successfully Apr 17 15:57:46 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:46 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 Apr 17 15:57:46 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:47 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 1073741824" returned: 0 in 0.489s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:47 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:47 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 Apr 17 15:57:47 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:47 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4 Apr 17 15:57:47 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "cinder-d099dcf2-4a5b-49c2-b3ba-5414461adf86-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-d099dcf2-4a5b-49c2-b3ba-5414461adf86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "cinder-quobyte-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-quobyte-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "cinder-quobyte-d099dcf2-4a5b-49c2-b3ba-5414461adf86" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-quobyte-d099dcf2-4a5b-49c2-b3ba-5414461adf86" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Deleting offline snapshot d099dcf2-4a5b-49c2-b3ba-5414461adf86 of volume 21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] snapshot_file for this snap is: volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a367d11-248a-484b-a6c5-3d469b60095f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:47 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 Apr 17 15:57:47 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:47 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014" returned: 0 in 0.429s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.296s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490781106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6934ef-c4b1-40c4-be12-2cebe059b6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Creating volume 0d6934ef-c4b1-40c4-be12-2cebe059b6fe {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:47 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:47 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2.9654a8a5-be46-40e0-b438-b9dc9c48bcf4" returned: 0 in 0.445s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:47 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe 1073741824 Apr 17 15:57:47 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c5295-c9a2-493a-b9a3-db4512d98613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858f9660-3926-4d77-a473-ac7afb2ac014', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11eaed30-aab7-4df4-83eb-09e1d8dbe765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-9654a8a5-be46-40e0-b438-b9dc9c48bcf4" released by "_delete_snapshot" :: held 1.924s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-25f3880b-c608-450d-ae37-f2206c28a2f2" released by "delete_snapshot" :: held 1.935s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:47 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume volume-858f9660-3926-4d77-a473-ac7afb2ac014 (858f9660-3926-4d77-a473-ac7afb2ac014): created successfully Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11eaed30-aab7-4df4-83eb-09e1d8dbe765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (ed0a6fa7-a75a-4045-aca3-c88d9b7dd0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:47 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b9d2b317-a00d-4a9f-a906-dc09bd1d5338 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created volume successfully. Apr 17 15:57:47 devstack cinder-volume[81996]: WARNING cinder.quota [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1702347146 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1702347146, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:47 devstack cinder-volume[81996]: WARNING cinder.quota [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1702347146 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1702347146, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Created reservations ['5b33f8a5-b83e-458f-b27f-bafdad0976a8', '7dd34500-248f-471c-8e62-99db4c991169', 'deaf0440-d88b-4bbc-8503-e56d9b01e6f9', '4e82189c-c6dc-4d14-a95c-cca23ff62c29'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] Created reservations ['685b3f50-6a2b-493c-bbd3-e2cbffefa5b7', '235f660a-e99b-4b67-8725-6001fa0c1ae7', 'dcef2b47-e82f-451c-a20e-3133d996b742', '7313e0f9-8465-45a0-9479-9676c6a2496e'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:47 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86" returned: 0 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[89413de0-85fb-467a-b75f-43bbbac08e63]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:47 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-84faf1b3-6a8d-4253-9739-13444f4037fd tempest-GroupSnapshotsTest-969576532 None] group_snapshot cf573051-3f7d-4410-876c-a2a79a673fb6: deleted successfully Apr 17 15:57:47 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f Apr 17 15:57:47 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:48 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe 1073741824" returned: 0 in 0.592s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:48 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe Apr 17 15:57:48 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-25f3880b-c608-450d-ae37-f2206c28a2f2" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-25f3880b-c608-450d-ae37-f2206c28a2f2" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b7a55d-cca0-4dd8-a85a-d24063190f8e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:48 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" returned: 0 in 0.532s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:48 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 Apr 17 15:57:48 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:48 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 Apr 17 15:57:48 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:48 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe" returned: 0 in 0.444s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.215s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-282298191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fec951-3db4-4f47-ad3b-ec7624d63c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Creating volume f8fec951-3db4-4f47-ad3b-ec7624d63c8b {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:48 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c618c3-ce3f-4b02-937a-5e074c0670aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:48 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b 1073741824 Apr 17 15:57:48 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a19c66-1804-4846-8ef1-e568ca1ff940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:48 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe (0d6934ef-c4b1-40c4-be12-2cebe059b6fe): created successfully Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a19c66-1804-4846-8ef1-e568ca1ff940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (fc5eff03-808c-433d-83bd-1063ae279fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1540dc4c-5dbc-47e9-b3c0-9a5b82f2333a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created volume successfully. Apr 17 15:57:48 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:48 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2 Apr 17 15:57:48 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:48 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86" returned: 0 in 0.490s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:48 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86 Apr 17 15:57:48 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:49 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b 1073741824" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:49 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b Apr 17 15:57:49 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:49 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-25f3880b-c608-450d-ae37-f2206c28a2f2" returned: 0 in 0.478s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-25f3880b-c608-450d-ae37-f2206c28a2f2" released by "delete_volume" :: held 0.995s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:49 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f.d099dcf2-4a5b-49c2-b3ba-5414461adf86" returned: 0 in 0.500s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5021323-df52-480a-8452-48f95df0ee9d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-quobyte-d099dcf2-4a5b-49c2-b3ba-5414461adf86" released by "_delete_snapshot" :: held 2.098s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-quobyte-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" released by "delete_snapshot" :: held 2.112s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:49 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb Apr 17 15:57:49 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Created reservations ['9089cf38-129d-4db6-9d32-03779ae2cc50', '75164184-64ef-4367-b4a9-038245403f3a', '5679277a-a3d5-46f6-8400-dfda584eec73', '7a235b14-2cf2-4e5f-bfd3-512c46c9ec40'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Delete snapshot completed successfully. Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bcae60fd-db98-44c1-bcfd-0454f79cb72b tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-d099dcf2-4a5b-49c2-b3ba-5414461adf86-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:49 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.424s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Creating offline snapshot 888b3363-fb5d-4c60-8602-ee8288962f13 of volume 244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c8477b-d623-42d6-bcd3-adbe26367878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089a3d7e-0261-4bba-8344-8147161cc6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[87629c59-62ff-4af3-abd6-6121bad40df0]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:49 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b (f8fec951-3db4-4f47-ad3b-ec7624d63c8b): created successfully Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089a3d7e-0261-4bba-8344-8147161cc6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (a57806ba-9557-4180-9f9f-81f6c6b3763b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ecf3279e-6f19-4151-8ef0-4da876100d2e tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created volume successfully. Apr 17 15:57:49 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 Apr 17 15:57:49 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:49 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" returned: 0 in 0.479s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:49 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb Apr 17 15:57:49 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:50 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:50 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 1G Apr 17 15:57:50 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:50 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-a3f2d32d-7cb4-4ef6-b23a-0a09c2cc83fb" released by "delete_volume" :: held 0.961s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Created reservations ['8bc6958c-b65c-40d3-aaf0-98b695ca4642'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:50 devstack cinder-volume[81996]: WARNING cinder.quota [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1702347146 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1702347146, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Created reservations ['26e75b6c-c199-4402-a107-e8e897e9d9eb', '58fa103f-23f4-4f53-9d15-ecbe3709f414', '03592389-2df4-4c03-b650-365c8d93560e', 'cd0d8bbe-99bd-4684-9f15-1b9475cdefd4'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Created reservations ['e99d31cb-bbf9-4217-9964-ea092fa7b6a5', '0c098f34-37a7-491d-9b43-5232c03a6116', 'c56540de-74dd-4ea0-ba84-b8a3a725e2f3', 'b7f403d2-7da0-4036-aa28-e13bbe5aa14d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "cinder-21c3ce33-bd4a-42fe-bbdf-f2824743f17f-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-21c3ce33-bd4a-42fe-bbdf-f2824743f17f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:50 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:50 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "cinder-quobyte-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-quobyte-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf71fdc-221f-4691-bd60-cdbdcfa03a23]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:50 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f Apr 17 15:57:50 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:50 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 1G" returned: 0 in 0.545s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244de2e3-05d7-4d9d-8728-0257f33170b1 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:50 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244de2e3-05d7-4d9d-8728-0257f33170b1 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 Apr 17 15:57:50 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:51 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.455s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4edd54df-0de2-479c-b0f6-dc810b3f9ce3 tempest-GroupSnapshotsTest-969576532 None] Delete group completed successfully. Apr 17 15:57:51 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" returned: 0 in 0.497s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:51 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:51 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f Apr 17 15:57:51 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244de2e3-05d7-4d9d-8728-0257f33170b1 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13" returned: 0 in 0.446s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:51 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 is being set with open permissions: ugo+rw Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:51 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 Apr 17 15:57:51 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:51 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" returned: 0 in 0.427s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:51 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13" returned: 0 in 0.414s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-quobyte-21c3ce33-bd4a-42fe-bbdf-f2824743f17f" released by "delete_volume" :: held 0.963s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Created reservations ['cc6bb8a4-b6b4-4c58-84de-185f0c475f1f', '5b31f084-c0d5-48aa-b38b-2414d2ac876f', 'af82f279-369b-45cd-8a11-a3549456f2cf', '0a4b8691-5420-4036-b0ea-e203862f1426'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:51 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.info Apr 17 15:57:51 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:51 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:51 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cae6706f-5799-4fc3-ae5f-a55b14bd14df tempest-GroupSnapshotsTest-969576532 None] Group tempest-GroupSnapshotsTest-Group-1746264062: creating Apr 17 15:57:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cae6706f-5799-4fc3-ae5f-a55b14bd14df tempest-GroupSnapshotsTest-969576532 None] Group tempest-GroupSnapshotsTest-Group-1746264062: created successfully Apr 17 15:57:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cae6706f-5799-4fc3-ae5f-a55b14bd14df tempest-GroupSnapshotsTest-969576532 None] Create group completed successfully. Apr 17 15:57:52 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.info" returned: 0 in 0.477s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:52 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.info is being set with open permissions: ugo+rw Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:52 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.info Apr 17 15:57:52 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:52 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.454s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:52 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Deleted volume successfully. Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b50cbd4-0960-46a0-8982-16eea0fd10bc tempest-VolumesSnapshotNegativeTestJSON-583451262 None] Lock "cinder-21c3ce33-bd4a-42fe-bbdf-f2824743f17f-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:52 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.info" returned: 0 in 0.409s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.891s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839843945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110ab3fd-a6f5-4f4d-91e6-767189b4647b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6da10bda83e4fdda556f3a82ec0b96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:37Z,use_quota=True,user_id='ca9dc6fea90645d2a04cd6e52039dd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Creating volume 110ab3fd-a6f5-4f4d-91e6-767189b4647b {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:52 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:52 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b 1073741824 Apr 17 15:57:52 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:52 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-aa9da552-8c73-4f8a-a0fd-bb4327c3e9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Create snapshot completed successfully Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "cinder-888b3363-fb5d-4c60-8602-ee8288962f13-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-888b3363-fb5d-4c60-8602-ee8288962f13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "cinder-quobyte-244de2e3-05d7-4d9d-8728-0257f33170b1" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-quobyte-244de2e3-05d7-4d9d-8728-0257f33170b1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:53 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "cinder-quobyte-888b3363-fb5d-4c60-8602-ee8288962f13" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b 1073741824" returned: 0 in 0.607s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-quobyte-888b3363-fb5d-4c60-8602-ee8288962f13" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Deleting offline snapshot 888b3363-fb5d-4c60-8602-ee8288962f13 of volume 244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] snapshot_file for this snap is: volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d31cc08-cd53-4f20-b10d-a6107f36640a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:53 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b Apr 17 15:57:53 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:53 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 Apr 17 15:57:53 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (b9dc7e2a-27dc-489d-8524-12c94702e3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20a400f-0e5a-4d0e-9fec-0036e142bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20a400f-0e5a-4d0e-9fec-0036e142bc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-518290281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=389b98ec-2e20-4ce8-83a2-61c6a7c66e82,host='devstack@QuobyteHD#QuobyteHD',id=5832db77-10fd-47a5-bedf-81f865de4002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:53Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6376ffe1-ae46-426d-a09c-f1953851b28f),volume_type_id=6376ffe1-ae46-426d-a09c-f1953851b28f)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8009fc48-84e1-4122-bcf9-fe19197eace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8009fc48-84e1-4122-bcf9-fe19197eace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a222ca-8097-4aba-820b-0c6c33a75bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a222ca-8097-4aba-820b-0c6c33a75bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5832db77-10fd-47a5-bedf-81f865de4002', 'volume_name': 'volume-5832db77-10fd-47a5-bedf-81f865de4002', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f697ad6d-a082-45af-b610-ebfc77a1482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f697ad6d-a082-45af-b610-ebfc77a1482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73de364-8cb1-43d7-9bbd-9fd8acbca74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:53 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Volume 5832db77-10fd-47a5-bedf-81f865de4002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5832db77-10fd-47a5-bedf-81f865de4002', 'volume_size': 1} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:53 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=389b98ec-2e20-4ce8-83a2-61c6a7c66e82,created_at=2026-04-17T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-518290281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=389b98ec-2e20-4ce8-83a2-61c6a7c66e82,host='devstack@QuobyteHD#QuobyteHD',id=5832db77-10fd-47a5-bedf-81f865de4002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61538311da940feb92419d045934e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:53Z,use_quota=True,user_id='fff1864eff31453ab39f903ed1affa1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6376ffe1-ae46-426d-a09c-f1953851b28f),volume_type_id=6376ffe1-ae46-426d-a09c-f1953851b28f)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Creating volume 5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:53 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:53 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 1073741824 Apr 17 15:57:53 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766ee630-68ad-4d20-b5c6-0797db312dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9ab289-1932-447e-98e2-0928344ed5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:53 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Volume volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b (110ab3fd-a6f5-4f4d-91e6-767189b4647b): created successfully Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9ab289-1932-447e-98e2-0928344ed5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Flow 'volume_create_manager' (baddc0a8-bd88-48ba-b541-785f474c6272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:53 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b04fa0f9-d78b-4a11-a603-5168cb739dca tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created volume successfully. Apr 17 15:57:53 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13" returned: 0 in 0.627s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-244de2e3-05d7-4d9d-8728-0257f33170b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1509d2-9ada-4f41-9f3a-4aaa3b719e08]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:53 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 Apr 17 15:57:53 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:54 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 1073741824" returned: 0 in 0.643s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:54 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1" returned: 0 in 0.570s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:54 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 Apr 17 15:57:54 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:54 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 Apr 17 15:57:54 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-f8fec951-3db4-4f47-ad3b-ec7624d63c8b-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-f8fec951-3db4-4f47-ad3b-ec7624d63c8b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-f8fec951-3db4-4f47-ad3b-ec7624d63c8b" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-f8fec951-3db4-4f47-ad3b-ec7624d63c8b" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[457e8d31-4c5f-41e2-9dca-35cee53c6f90]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:54 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b Apr 17 15:57:54 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (58a45d5d-dc96-42c7-af97-9eda77ef4c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7859b4ec-33c5-46f0-b7b5-d077c3599f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7859b4ec-33c5-46f0-b7b5-d077c3599f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1582591737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c97f564-8852-4759-855a-a3507d2c6920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:55Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acbf038-cf0a-43ef-a042-9cfa37edf4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acbf038-cf0a-43ef-a042-9cfa37edf4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f37cb0c-af06-41f2-9607-50df9dec75e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f37cb0c-af06-41f2-9607-50df9dec75e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c97f564-8852-4759-855a-a3507d2c6920', 'volume_name': 'volume-7c97f564-8852-4759-855a-a3507d2c6920', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8572792e-e60c-4c09-959e-372eda8b4e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8572792e-e60c-4c09-959e-372eda8b4e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f2c3a6-06f8-4ff1-9ffb-f2c63262db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:54 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume 7c97f564-8852-4759-855a-a3507d2c6920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c97f564-8852-4759-855a-a3507d2c6920', 'volume_size': 1} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:54 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002" returned: 0 in 0.489s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1582591737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c97f564-8852-4759-855a-a3507d2c6920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:55Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Creating volume 7c97f564-8852-4759-855a-a3507d2c6920 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:54 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73de364-8cb1-43d7-9bbd-9fd8acbca74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5832db77-10fd-47a5-bedf-81f865de4002', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:55 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 1073741824 Apr 17 15:57:55 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa67859-827c-47e9-92b8-c1ebcf49819f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:55 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Volume volume-5832db77-10fd-47a5-bedf-81f865de4002 (5832db77-10fd-47a5-bedf-81f865de4002): created successfully Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa67859-827c-47e9-92b8-c1ebcf49819f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Flow 'volume_create_manager' (b9dc7e2a-27dc-489d-8524-12c94702e3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b5c2cacd-108c-4395-a949-a3c1c24f60ec tempest-GroupSnapshotsTest-969576532 None] Created volume successfully. Apr 17 15:57:55 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13" returned: 0 in 0.637s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:55 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13 Apr 17 15:57:55 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:55 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b" returned: 0 in 0.536s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:55 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b Apr 17 15:57:55 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:55 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1.888b3363-fb5d-4c60-8602-ee8288962f13" returned: 0 in 0.454s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:55 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 1073741824" returned: 0 in 0.604s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-quobyte-888b3363-fb5d-4c60-8602-ee8288962f13" released by "_delete_snapshot" :: held 2.384s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-quobyte-244de2e3-05d7-4d9d-8728-0257f33170b1" released by "delete_snapshot" :: held 2.421s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:55 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 Apr 17 15:57:55 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] GroupSnapshot 90ffb65b-d390-4c38-8a3c-a94a3d9e4451: creating. Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Created reservations ['96db58c6-f88f-4e48-97cd-f624a957dd01', 'bc720f5a-9ce7-4348-a1ce-e13f83f86ad4', 'ec7a0427-4ebd-44b7-a42a-851f625b4046', '07c23e95-ed19-4a1b-9927-c79ad90a14bc'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Group snapshot 90ffb65b-d390-4c38-8a3c-a94a3d9e4451: creating. {{(pid=81996) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Delete snapshot completed successfully. Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ea09d4b7-fdd7-48a6-8529-c52d3c8dc6fc tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-888b3363-fb5d-4c60-8602-ee8288962f13-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:55 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f8fec951-3db4-4f47-ad3b-ec7624d63c8b" returned: 0 in 0.530s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-f8fec951-3db4-4f47-ad3b-ec7624d63c8b" released by "delete_volume" :: held 1.089s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created reservations ['a9d98429-49ef-48af-bb29-b867dbe749e0', '220960a9-2a0d-4625-8272-a396fd743e3b', '06aaff27-7b05-4cd8-a14a-c087cd91021c', 'a492797d-b618-4157-8524-0ceaa19728fc'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:55 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:55 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:56 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920" returned: 0 in 0.476s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.399s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Creating offline snapshot 5e90ab30-c056-43fc-9813-5ebe0bf2742d of volume 5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f2c3a6-06f8-4ff1-9ffb-f2c63262db90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c97f564-8852-4759-855a-a3507d2c6920', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae9560f-69d4-4d59-94f9-4a03141f9ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0121bb-82d3-48e3-b200-4bf1c823bb51]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:56 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume volume-7c97f564-8852-4759-855a-a3507d2c6920 (7c97f564-8852-4759-855a-a3507d2c6920): created successfully Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae9560f-69d4-4d59-94f9-4a03141f9ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (58a45d5d-dc96-42c7-af97-9eda77ef4c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:56 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f69d1b10-b015-44c2-bd3b-f4f988c2f51c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created volume successfully. Apr 17 15:57:56 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 Apr 17 15:57:56 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:56 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.416s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:56 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Deleted volume successfully. Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fa55197e-6e64-44b6-a035-4906eb7b050a tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-f8fec951-3db4-4f47-ad3b-ec7624d63c8b-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "cinder-244de2e3-05d7-4d9d-8728-0257f33170b1-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-244de2e3-05d7-4d9d-8728-0257f33170b1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "cinder-quobyte-244de2e3-05d7-4d9d-8728-0257f33170b1" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-quobyte-244de2e3-05d7-4d9d-8728-0257f33170b1" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[477cc7dd-62b7-4992-8d1e-6abf1373004f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:56 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 Apr 17 15:57:56 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:56 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002" returned: 0 in 0.524s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:56 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d 1G Apr 17 15:57:56 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-0d6934ef-c4b1-40c4-be12-2cebe059b6fe-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-0d6934ef-c4b1-40c4-be12-2cebe059b6fe-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-0d6934ef-c4b1-40c4-be12-2cebe059b6fe" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-0d6934ef-c4b1-40c4-be12-2cebe059b6fe" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e094e152-df28-42a9-9eed-cecfd7c804e8]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:56 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe Apr 17 15:57:56 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:57 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1" returned: 0 in 0.601s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:57 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1 Apr 17 15:57:57 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:57 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d 1G" returned: 0 in 0.515s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5832db77-10fd-47a5-bedf-81f865de4002 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:57 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5832db77-10fd-47a5-bedf-81f865de4002 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d Apr 17 15:57:57 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (534a7d36-8a8b-400b-b5b9-6de6d731ec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdccf18e-e886-421d-a1a7-5eece4a74f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdccf18e-e886-421d-a1a7-5eece4a74f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-796356206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b850984-a499-4d7f-b220-9610910830dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:57Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c5e76c-66df-4f63-90dc-e7ffbd111424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c5e76c-66df-4f63-90dc-e7ffbd111424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8528ef4d-2bbf-4104-8856-2ce902c1a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8528ef4d-2bbf-4104-8856-2ce902c1a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b850984-a499-4d7f-b220-9610910830dc', 'volume_name': 'volume-4b850984-a499-4d7f-b220-9610910830dc', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68540405-7e5b-4758-9a8e-58910353a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68540405-7e5b-4758-9a8e-58910353a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f4a593-b6ff-4bdc-906c-ab2c0af35536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume 4b850984-a499-4d7f-b220-9610910830dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b850984-a499-4d7f-b220-9610910830dc', 'volume_size': 1} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:57 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe" returned: 0 in 0.567s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:57 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe Apr 17 15:57:57 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (37e89d5b-0a38-4130-a175-ef768c92c0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b54a6b-ee2c-4799-a653-aa7300c7d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b54a6b-ee2c-4799-a653-aa7300c7d643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931550259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45577b0c-f4a5-4760-9d85-585f9a248e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e82edd-c540-4d3f-990a-26993fc8534c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e82edd-c540-4d3f-990a-26993fc8534c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bc1deb-e13d-4779-b172-3b55b6674d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bc1deb-e13d-4779-b172-3b55b6674d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45577b0c-f4a5-4760-9d85-585f9a248e7c', 'volume_name': 'volume-45577b0c-f4a5-4760-9d85-585f9a248e7c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2e024f-06e5-4fea-8ea9-947202626cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2e024f-06e5-4fea-8ea9-947202626cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befa9cf0-96f2-4111-90f2-c4bbb67b2bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume 45577b0c-f4a5-4760-9d85-585f9a248e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45577b0c-f4a5-4760-9d85-585f9a248e7c', 'volume_size': 1} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:57 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-244de2e3-05d7-4d9d-8728-0257f33170b1" returned: 0 in 0.607s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-quobyte-244de2e3-05d7-4d9d-8728-0257f33170b1" released by "delete_volume" :: held 1.254s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Created reservations ['ff28c08d-44f0-4454-a994-e376121e3653', 'e79ea502-db0c-4b4b-b437-3e1d81fa592a', '9f116575-ff07-4837-8887-929528538fe3', 'c7ebbd54-d0f2-4e6d-b174-1a1d63b96707'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:57 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5832db77-10fd-47a5-bedf-81f865de4002 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d" returned: 0 in 0.581s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:57 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:57 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d Apr 17 15:57:57 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:57 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:57 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (f0b981eb-9050-4957-b3dc-515fb1fe6c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951c316e-0c94-4b6d-8bbe-ed5ce90fe88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951c316e-0c94-4b6d-8bbe-ed5ce90fe88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-29277323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e9aafc-4ed7-4885-a777-ebcfcaea00cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91608b02-a29d-4378-9cc0-4a2f3d1e27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91608b02-a29d-4378-9cc0-4a2f3d1e27b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ccf8bf0-17ab-4d65-b134-8b784431dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ccf8bf0-17ab-4d65-b134-8b784431dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e9aafc-4ed7-4885-a777-ebcfcaea00cd', 'volume_name': 'volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba19dbb3-e327-470f-9fe4-b83f96f636b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba19dbb3-e327-470f-9fe4-b83f96f636b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e82b646-112c-40bd-af6a-c6d81ec4cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume 30e9aafc-4ed7-4885-a777-ebcfcaea00cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd', 'volume_size': 1} Apr 17 15:57:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:58 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (839c7138-1c5c-41d1-9d42-2a05fa83c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5980d199-61c2-4e7b-b6d7-17f79f17ae50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5980d199-61c2-4e7b-b6d7-17f79f17ae50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470259820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7a566c-0fa5-4c92-8429-7dd2fedba796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f86fc0-c227-44d6-bbc1-f7ae47c32a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f86fc0-c227-44d6-bbc1-f7ae47c32a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9a8ccb-efeb-4a12-9bbe-eec1603a3115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9a8ccb-efeb-4a12-9bbe-eec1603a3115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a7a566c-0fa5-4c92-8429-7dd2fedba796', 'volume_name': 'volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3e4d97-58fb-4f86-9ba4-42de28e288eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3e4d97-58fb-4f86-9ba4-42de28e288eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac71ac7-ce50-4fdd-a0fe-9c97fd81ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume 6a7a566c-0fa5-4c92-8429-7dd2fedba796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796', 'volume_size': 1} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d6934ef-c4b1-40c4-be12-2cebe059b6fe" returned: 0 in 0.737s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-0d6934ef-c4b1-40c4-be12-2cebe059b6fe" released by "delete_volume" :: held 1.347s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created reservations ['a53df8c4-7c70-419f-b6e7-1c0eb9c6a94e', '7cc22724-bff4-42aa-bd21-2191918e2398', 'e7169e12-c74b-4bf7-87f8-a249df7b8af5', 'a8346c49-1277-4488-8fc8-51788174d5bf'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:58 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d" returned: 0 in 0.515s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:58 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:57:58 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:58 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.info Apr 17 15:57:58 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (37ac2a9b-68f1-450f-a9e0-44bdce0ae40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259213d0-ed9d-4d56-abf1-cbe77cc15f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259213d0-ed9d-4d56-abf1-cbe77cc15f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864217539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca06fa6-915c-453b-ad6b-251e1a1d735a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed79ea0-115a-47ce-9063-95a08ba0eb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed79ea0-115a-47ce-9063-95a08ba0eb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cbe13f-3143-45ca-a02d-4ea158ef9594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cbe13f-3143-45ca-a02d-4ea158ef9594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca06fa6-915c-453b-ad6b-251e1a1d735a', 'volume_name': 'volume-bca06fa6-915c-453b-ad6b-251e1a1d735a', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63023a91-a1b0-42d6-b28a-7f509903c049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63023a91-a1b0-42d6-b28a-7f509903c049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4733ff-1fce-45c5-85de-5bdad1d94b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:57:58 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume bca06fa6-915c-453b-ad6b-251e1a1d735a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca06fa6-915c-453b-ad6b-251e1a1d735a', 'volume_size': 1} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.675s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Deleted volume successfully. Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6d29133f-247b-46f8-a77e-5f609ae6d22f tempest-VolumeSnapshotQuotasNegativeTestJSON-219441168 None] Lock "cinder-244de2e3-05d7-4d9d-8728-0257f33170b1-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:58 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.info" returned: 0 in 0.456s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:58 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:58 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.info Apr 17 15:57:58 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:58 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.521s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:57:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Deleted volume successfully. Apr 17 15:57:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f7582ee2-bd58-495d-bcd9-9b98d64105f8 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-0d6934ef-c4b1-40c4-be12-2cebe059b6fe-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-858f9660-3926-4d77-a473-ac7afb2ac014-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-858f9660-3926-4d77-a473-ac7afb2ac014-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-858f9660-3926-4d77-a473-ac7afb2ac014" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-858f9660-3926-4d77-a473-ac7afb2ac014" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac211b7a-fe51-42fe-bdbd-9e95357ec2a1]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:59 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 Apr 17 15:57:59 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:59 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.info" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-796356206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b850984-a499-4d7f-b220-9610910830dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:57Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Creating volume 4b850984-a499-4d7f-b220-9610910830dc {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:57:59 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:59 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc 1073741824 Apr 17 15:57:59 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:59 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b5e6fcda-6c67-477b-b8af-7767ebf90afd tempest-GroupSnapshotsTest-969576532 None] group_snapshot 90ffb65b-d390-4c38-8a3c-a94a3d9e4451: created successfully Apr 17 15:57:59 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014" returned: 0 in 0.602s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:59 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014 Apr 17 15:57:59 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:57:59 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc 1073741824" returned: 0 in 0.613s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:57:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:57:59 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc Apr 17 15:57:59 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] group_snapshot 90ffb65b-d390-4c38-8a3c-a94a3d9e4451: deleting Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] group_snapshot 90ffb65b-d390-4c38-8a3c-a94a3d9e4451: deleting {{(pid=81996) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-5832db77-10fd-47a5-bedf-81f865de4002" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-5832db77-10fd-47a5-bedf-81f865de4002" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-5e90ab30-c056-43fc-9813-5ebe0bf2742d" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-5e90ab30-c056-43fc-9813-5ebe0bf2742d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Deleting offline snapshot 5e90ab30-c056-43fc-9813-5ebe0bf2742d of volume 5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] snapshot_file for this snap is: volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[577081f4-0dd0-4359-a99d-bf6ff7af5867]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:00 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d Apr 17 15:58:00 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:00 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-858f9660-3926-4d77-a473-ac7afb2ac014" returned: 0 in 0.568s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-858f9660-3926-4d77-a473-ac7afb2ac014" released by "delete_volume" :: held 1.192s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created reservations ['6f5ac5e3-7c23-484e-b8d9-3ec07cdab87a', '4faa1332-466e-4d3e-be3a-0406af9265fe', 'ed79c584-7567-4449-a9df-4205157974da', 'a4eb805b-91c8-42f8-a5df-ef992615d203'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:00 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:00 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:00 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc" returned: 0 in 0.694s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.919s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931550259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45577b0c-f4a5-4760-9d85-585f9a248e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Creating volume 45577b0c-f4a5-4760-9d85-585f9a248e7c {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:00 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f4a593-b6ff-4bdc-906c-ab2c0af35536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b850984-a499-4d7f-b220-9610910830dc', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3291d6-0fee-4fa1-99d8-fdcbca2aae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:00 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c 1073741824 Apr 17 15:58:00 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume volume-4b850984-a499-4d7f-b220-9610910830dc (4b850984-a499-4d7f-b220-9610910830dc): created successfully Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3291d6-0fee-4fa1-99d8-fdcbca2aae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (534a7d36-8a8b-400b-b5b9-6de6d731ec49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e6c45237-ce0e-4e3d-a90b-b2a69f6d3de8 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created volume successfully. Apr 17 15:58:00 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d" returned: 0 in 0.651s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5832db77-10fd-47a5-bedf-81f865de4002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:00 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.502s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[24345dab-e439-42e0-8026-13229eb88954]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Deleted volume successfully. Apr 17 15:58:00 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3644b53c-ad5a-4dd0-b69c-e2ec16ce4274 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-858f9660-3926-4d77-a473-ac7afb2ac014-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:00 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 Apr 17 15:58:00 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:01 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c 1073741824" returned: 0 in 0.600s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-b0682259-3512-4264-b16e-556f98d82ab5-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-b0682259-3512-4264-b16e-556f98d82ab5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:01 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c Apr 17 15:58:01 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-b0682259-3512-4264-b16e-556f98d82ab5" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-b0682259-3512-4264-b16e-556f98d82ab5" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a51a5-5ac8-4ee8-933e-826605160cfb]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:01 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 Apr 17 15:58:01 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:01 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002" returned: 0 in 0.639s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:01 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d Apr 17 15:58:01 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:01 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:01 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5" returned: 0 in 0.562s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c" returned: 0 in 0.654s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.931s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-29277323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e9aafc-4ed7-4885-a777-ebcfcaea00cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Creating volume 30e9aafc-4ed7-4885-a777-ebcfcaea00cd {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:01 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5 Apr 17 15:58:01 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:01 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befa9cf0-96f2-4111-90f2-c4bbb67b2bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45577b0c-f4a5-4760-9d85-585f9a248e7c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d35c0ec-2ef1-4e20-9344-150b15f5a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:01 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd 1073741824 Apr 17 15:58:01 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume volume-45577b0c-f4a5-4760-9d85-585f9a248e7c (45577b0c-f4a5-4760-9d85-585f9a248e7c): created successfully Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d35c0ec-2ef1-4e20-9344-150b15f5a99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (37e89d5b-0a38-4130-a175-ef768c92c0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:01 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f7d423ea-db04-4c6f-9014-2e31f2ba63e9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created volume successfully. Apr 17 15:58:02 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d" returned: 0 in 0.636s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:02 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d Apr 17 15:58:02 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:02 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b0682259-3512-4264-b16e-556f98d82ab5" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-b0682259-3512-4264-b16e-556f98d82ab5" released by "delete_volume" :: held 1.092s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created reservations ['3b015ca2-660f-4031-8974-77bc4cb56b05', '00276851-6639-4eea-b72c-c31d6d71c024', '21b61efe-2326-4f3f-b364-1a354ac2387c', '4c5b54f8-ca90-465d-b081-c3d63880086f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:02 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:02 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:02 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd 1073741824" returned: 0 in 0.684s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:02 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd Apr 17 15:58:02 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:02 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002.5e90ab30-c056-43fc-9813-5ebe0bf2742d" returned: 0 in 0.537s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-5e90ab30-c056-43fc-9813-5ebe0bf2742d" released by "_delete_snapshot" :: held 2.528s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-5832db77-10fd-47a5-bedf-81f865de4002" released by "delete_snapshot" :: held 2.540s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:02 devstack cinder-volume[81996]: WARNING cinder.quota [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1860274048 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1860274048, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:02 devstack cinder-volume[81996]: WARNING cinder.quota [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1860274048 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1860274048, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:02 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] Created reservations ['68eeb129-6364-4528-88e5-490659e0ba9c', '75ba45cc-9643-4665-bcc0-e28de2cf1f64', '22dc1228-c1c0-4c37-9066-dfee81eb24a7', '2169d55f-1d8f-4f8c-b007-a157e7812fc1'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:02 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-614bd282-0aa5-4334-888a-3fe5f810683e tempest-GroupSnapshotsTest-969576532 None] group_snapshot 90ffb65b-d390-4c38-8a3c-a94a3d9e4451: deleted successfully Apr 17 15:58:03 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.489s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:03 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Deleted volume successfully. Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f325b582-6b5a-4502-8eaa-b0452cfd4316 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-b0682259-3512-4264-b16e-556f98d82ab5-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:03 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd" returned: 0 in 0.578s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.011s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470259820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7a566c-0fa5-4c92-8429-7dd2fedba796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Creating volume 6a7a566c-0fa5-4c92-8429-7dd2fedba796 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:03 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e82b646-112c-40bd-af6a-c6d81ec4cab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:03 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 1073741824 Apr 17 15:58:03 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0093693-0f05-4e86-9fd2-849d93c4b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:03 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd (30e9aafc-4ed7-4885-a777-ebcfcaea00cd): created successfully Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0093693-0f05-4e86-9fd2-849d93c4b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (f0b981eb-9050-4957-b3dc-515fb1fe6c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:03 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-10d587d2-a945-48d0-b2ba-e0082d1cb395 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created volume successfully. Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-110ab3fd-a6f5-4f4d-91e6-767189b4647b-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-110ab3fd-a6f5-4f4d-91e6-767189b4647b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-110ab3fd-a6f5-4f4d-91e6-767189b4647b" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-110ab3fd-a6f5-4f4d-91e6-767189b4647b" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130b7f7-03fe-499b-940d-246af3bbcfcd]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "cinder-quobyte-5832db77-10fd-47a5-bedf-81f865de4002" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-5832db77-10fd-47a5-bedf-81f865de4002" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d62a3c-dd65-4444-90ee-ab16ad407cc4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:03 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b Apr 17 15:58:03 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:03 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 Apr 17 15:58:03 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:03 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 1073741824" returned: 0 in 0.680s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:03 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 Apr 17 15:58:03 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:04 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b" returned: 0 in 0.632s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:04 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b Apr 17 15:58:04 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:04 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002" returned: 0 in 0.621s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:04 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002 Apr 17 15:58:04 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:04 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796" returned: 0 in 0.501s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.962s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864217539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca06fa6-915c-453b-ad6b-251e1a1d735a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f44ea8452423189a8e3afae31d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:57:58Z,use_quota=True,user_id='6e22f7836a574f39921c5c3ce0e9e80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Creating volume bca06fa6-915c-453b-ad6b-251e1a1d735a {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:04 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac71ac7-ce50-4fdd-a0fe-9c97fd81ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ae07dc-9a54-4699-a499-bfc390f2638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:04 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 (6a7a566c-0fa5-4c92-8429-7dd2fedba796): created successfully Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ae07dc-9a54-4699-a499-bfc390f2638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (839c7138-1c5c-41d1-9d42-2a05fa83c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:04 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7e4bb5ba-cd51-4871-8376-54569ec49f12 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created volume successfully. Apr 17 15:58:04 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a 1073741824 Apr 17 15:58:04 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:04 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-110ab3fd-a6f5-4f4d-91e6-767189b4647b" returned: 0 in 0.521s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-110ab3fd-a6f5-4f4d-91e6-767189b4647b" released by "delete_volume" :: held 1.179s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:04 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5832db77-10fd-47a5-bedf-81f865de4002" returned: 0 in 0.495s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Lock "cinder-quobyte-5832db77-10fd-47a5-bedf-81f865de4002" released by "delete_volume" :: held 1.158s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created reservations ['8f1f6067-f9c8-4443-bcfe-2e6ec7f85242', '994a3b22-6cce-475c-81c5-f41d914611ce', '40486d8b-8c75-4683-9d98-1da603a7fa13', '7c9be7f9-2140-4383-82a0-75b2dd502776'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Created reservations ['4ee3892c-5b37-4853-b094-d9dab9d28e43'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:04 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:04 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:04 devstack cinder-volume[81996]: WARNING cinder.quota [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1860274048 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1860274048, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Created reservations ['5a7de362-b03f-46d4-998f-8de46ef68ad4', '303fed22-2a2b-4db0-a646-cb9fe4251fa7', '277ec563-cdd4-4ddf-a2c9-baa11c44e2b2', '684ffc8f-7271-4372-ab53-90f31fef59aa'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:04 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:04 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:05 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a 1073741824" returned: 0 in 0.773s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:05 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a Apr 17 15:58:05 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:05 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.500s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Deleted volume successfully. Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-af147b0a-7ca9-4858-a92b-33859a080886 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-110ab3fd-a6f5-4f4d-91e6-767189b4647b-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:05 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.541s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-66f17f8b-f0ad-48b6-bd64-a0a8cf238e5a tempest-GroupSnapshotsTest-969576532 None] Delete group completed successfully. Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-a7a74176-04d1-4234-9e67-90dc8a00fed0-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-a7a74176-04d1-4234-9e67-90dc8a00fed0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-85e38115-78a7-4deb-8746-6705ea521e41" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-85e38115-78a7-4deb-8746-6705ea521e41" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-a7a74176-04d1-4234-9e67-90dc8a00fed0" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-a7a74176-04d1-4234-9e67-90dc8a00fed0" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Deleting offline snapshot a7a74176-04d1-4234-9e67-90dc8a00fed0 of volume 85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] snapshot_file for this snap is: volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[874eb13b-19b7-4652-8804-8b71a0fd12a6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:05 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=266,cinder:INSERT=85,cinder:UPDATE=286,cinder:DELETE=15 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4733ff-1fce-45c5-85de-5bdad1d94b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca06fa6-915c-453b-ad6b-251e1a1d735a', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c184078-b2d0-4074-8d8c-032a64e281c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=269,cinder:INSERT=72,cinder:UPDATE=322,cinder:DELETE=24 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:58:05 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Volume volume-bca06fa6-915c-453b-ad6b-251e1a1d735a (bca06fa6-915c-453b-ad6b-251e1a1d735a): created successfully Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c184078-b2d0-4074-8d8c-032a64e281c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Flow 'volume_create_manager' (37ac2a9b-68f1-450f-a9e0-44bdce0ae40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:05 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 Apr 17 15:58:05 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-74426fb6-a81f-4e98-9f04-c40aac0a3494 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created volume successfully. Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-bca06fa6-915c-453b-ad6b-251e1a1d735a-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-bca06fa6-915c-453b-ad6b-251e1a1d735a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-quobyte-bca06fa6-915c-453b-ad6b-251e1a1d735a" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-bca06fa6-915c-453b-ad6b-251e1a1d735a" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab0a43e-a36c-4129-b125-bde8623a01a3]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:06 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0" returned: 0 in 0.589s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e38115-78a7-4deb-8746-6705ea521e41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da8b90-bb3a-4920-aa17-e7a2034c038d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:06 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a Apr 17 15:58:06 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:06 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 Apr 17 15:58:06 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:06 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a" returned: 0 in 0.564s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:06 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a Apr 17 15:58:06 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:06 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41" returned: 0 in 0.597s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:06 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 Apr 17 15:58:06 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Flow 'volume_create_manager' (1c870080-3523-4a35-a9c4-4ccdae6021cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0961b5-b5c1-4461-bd35-08518c819ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0961b5-b5c1-4461-bd35-08518c819ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1471409581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2c0b2e-66a2-4014-b5a5-8913f5d756ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99443661a29d42bc9ad20ee1a5779028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:07Z,use_quota=True,user_id='525dcabc00a045c19bc0e59854114ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e64d9f-484c-4c92-ad4b-f91e398810dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e64d9f-484c-4c92-ad4b-f91e398810dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0196a77-2839-400c-9e56-c4956cbe207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0196a77-2839-400c-9e56-c4956cbe207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2c0b2e-66a2-4014-b5a5-8913f5d756ed', 'volume_name': 'volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f3b0d-647c-4e2a-abc8-cd926ef5fb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f3b0d-647c-4e2a-abc8-cd926ef5fb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7709fe07-8b1a-49c4-99bd-61d3f3517fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:07 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Volume 8b2c0b2e-66a2-4014-b5a5-8913f5d756ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed', 'volume_size': 1} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1471409581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2c0b2e-66a2-4014-b5a5-8913f5d756ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99443661a29d42bc9ad20ee1a5779028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:07Z,use_quota=True,user_id='525dcabc00a045c19bc0e59854114ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Creating volume 8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:07 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:07 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed 1073741824 Apr 17 15:58:07 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:07 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bca06fa6-915c-453b-ad6b-251e1a1d735a" returned: 0 in 0.597s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-bca06fa6-915c-453b-ad6b-251e1a1d735a" released by "delete_volume" :: held 1.185s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created reservations ['f7ae805a-c70f-4978-b29c-617bc464f979', '156b6be7-ac8f-481f-8e0e-a2678a92a246', '7e647e76-4f4b-41ea-bb1d-06513c962dbb', 'a61aa029-6029-48dd-9971-157ba4836b23'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:07 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0" returned: 0 in 0.590s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:07 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:07 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:07 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0 Apr 17 15:58:07 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:07 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed 1073741824" returned: 0 in 0.725s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:07 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed Apr 17 15:58:07 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:07 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.501s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Deleted volume successfully. Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-bce59f75-8e75-4a38-998c-8ee87963c719 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-bca06fa6-915c-453b-ad6b-251e1a1d735a-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:08 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41.a7a74176-04d1-4234-9e67-90dc8a00fed0" returned: 0 in 0.574s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-a7a74176-04d1-4234-9e67-90dc8a00fed0" released by "_delete_snapshot" :: held 2.409s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-85e38115-78a7-4deb-8746-6705ea521e41" released by "delete_snapshot" :: held 2.425s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created reservations ['83f99206-f7db-4f90-aa44-015bcd8a07f6', '5e01575f-460c-45d6-ab54-79bca0d0900a', '6699713e-8698-4768-ae72-290fc58e4663', '1d0f0fd7-aa62-4d60-8955-4f9648efcd4a'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Delete snapshot completed successfully. Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-08692cfa-a2d9-4aad-b03f-a289b67c5734 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-a7a74176-04d1-4234-9e67-90dc8a00fed0-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:08 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" returned: 0 in 0.472s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7709fe07-8b1a-49c4-99bd-61d3f3517fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5052fe67-7d31-45c9-8211-162d8fb639e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:08 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Volume volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed (8b2c0b2e-66a2-4014-b5a5-8913f5d756ed): created successfully Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5052fe67-7d31-45c9-8211-162d8fb639e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Flow 'volume_create_manager' (1c870080-3523-4a35-a9c4-4ccdae6021cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-bab66657-a1be-4d4a-9592-b5a7083c23b8 tempest-VolumesDeleteCascade-1698121326 None] Created volume successfully. Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-6a7a566c-0fa5-4c92-8429-7dd2fedba796-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-6a7a566c-0fa5-4c92-8429-7dd2fedba796-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-quobyte-6a7a566c-0fa5-4c92-8429-7dd2fedba796" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-6a7a566c-0fa5-4c92-8429-7dd2fedba796" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2a6530-225e-441c-8aa5-3fa5ade15409]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:08 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 Apr 17 15:58:08 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-85e38115-78a7-4deb-8746-6705ea521e41-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-85e38115-78a7-4deb-8746-6705ea521e41-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "cinder-quobyte-85e38115-78a7-4deb-8746-6705ea521e41" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-85e38115-78a7-4deb-8746-6705ea521e41" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e338b-04a5-4a9b-90ff-018d0f0951a5]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:09 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796" returned: 0 in 0.569s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:09 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 Apr 17 15:58:09 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:09 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796 Apr 17 15:58:09 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Creating offline snapshot cad5b70d-9d58-41dc-9613-3ea3491f1e83 of volume 8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c3b085-156d-4e89-a57f-fcb8964d0175]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:09 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed Apr 17 15:58:09 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:09 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cb9f0f6d-9e08-4bbc-ae41-998b55035a82 tempest-GroupsTest-493144520 None] Group tempest-Group1-33586214: creating Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6a7a566c-0fa5-4c92-8429-7dd2fedba796" returned: 0 in 0.487s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-6a7a566c-0fa5-4c92-8429-7dd2fedba796" released by "delete_volume" :: held 1.101s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:09 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cb9f0f6d-9e08-4bbc-ae41-998b55035a82 tempest-GroupsTest-493144520 None] Group tempest-Group1-33586214: created successfully Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41" returned: 0 in 0.604s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:09 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41 Apr 17 15:58:09 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cb9f0f6d-9e08-4bbc-ae41-998b55035a82 tempest-GroupsTest-493144520 None] Create group completed successfully. Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created reservations ['c0c1ff51-3618-4520-973b-db0b7ac03be4', 'eaff41d9-33fe-4200-b00b-c6bc47308079', '13ce2301-704e-4064-8a95-2643a6243f01', '46e03ba1-0528-4788-8c84-d1a566bf0133'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:09 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:09 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:09 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" returned: 0 in 0.575s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:09 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 1G Apr 17 15:58:09 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:09 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-85e38115-78a7-4deb-8746-6705ea521e41" returned: 0 in 0.423s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-quobyte-85e38115-78a7-4deb-8746-6705ea521e41" released by "delete_volume" :: held 1.068s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Created reservations ['c971e8be-e9cf-4f82-b099-e6edfeacef37', 'd43fade7-d00d-4faa-9b08-9ebef7ce4950', 'a9494400-31c6-4dd4-94f1-2b4803fbf6b9', '40a57f53-f2fd-4787-91e2-032890d78151'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:10 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.420s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Deleted volume successfully. Apr 17 15:58:10 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:10 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-254415fb-b20a-4b93-9780-84ab023b9a51 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-6a7a566c-0fa5-4c92-8429-7dd2fedba796-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:10 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 1G" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:10 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 Apr 17 15:58:10 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:10 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.479s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Deleted volume successfully. Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a39b2e96-8880-4d47-9408-31d372daf1c7 tempest-CreateVolumesFromSnapshotTest-1122419679 None] Lock "cinder-85e38115-78a7-4deb-8746-6705ea521e41-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-30e9aafc-4ed7-4885-a777-ebcfcaea00cd-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-30e9aafc-4ed7-4885-a777-ebcfcaea00cd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-quobyte-30e9aafc-4ed7-4885-a777-ebcfcaea00cd" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-30e9aafc-4ed7-4885-a777-ebcfcaea00cd" acquired by "delete_volume" :: waited 0.026s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dce10b5-c402-4703-87a7-d7110d80854e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-118b80e0-54fd-4133-ba5e-05014e6555d0 tempest-GroupsTest-493144520 None] Group tempest-Group2-726063287: creating Apr 17 15:58:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-118b80e0-54fd-4133-ba5e-05014e6555d0 tempest-GroupsTest-493144520 None] Group tempest-Group2-726063287: created successfully Apr 17 15:58:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-118b80e0-54fd-4133-ba5e-05014e6555d0 tempest-GroupsTest-493144520 None] Create group completed successfully. Apr 17 15:58:10 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd Apr 17 15:58:10 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:10 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83" returned: 0 in 0.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:10 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 is being set with open permissions: ugo+rw Apr 17 15:58:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:10 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 Apr 17 15:58:10 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:11 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd" returned: 0 in 0.525s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:11 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd Apr 17 15:58:11 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:11 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:11 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.info Apr 17 15:58:11 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:11 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-30e9aafc-4ed7-4885-a777-ebcfcaea00cd" returned: 0 in 0.443s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-30e9aafc-4ed7-4885-a777-ebcfcaea00cd" released by "delete_volume" :: held 0.995s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created reservations ['091edafe-7d8c-48a8-925b-dda4e40bad0f', '6b82abd0-b7dc-4f20-ae9f-e426de733024', '85cb1387-60f2-45a9-bc22-519434e45955', '43c78d2c-da32-4b34-b773-0473b505c39d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:11 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:11 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:11 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.info" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:11 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.info is being set with open permissions: ugo+rw Apr 17 15:58:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:11 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.info Apr 17 15:58:11 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Flow 'volume_create_manager' (0e9b26f1-709a-4aeb-b66e-5cc4ec8b9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46045f1c-6bfb-41da-b05c-5af52766e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46045f1c-6bfb-41da-b05c-5af52766e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1444113142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e24df63b-9dfc-4407-9540-108135d03224,host='devstack@QuobyteHD#QuobyteHD',id=e98c7203-fa1c-413f-9487-045ad0c185c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87419caec2c7487a874d8e8a57235a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:12Z,use_quota=True,user_id='25a665a9574b469294f854991f08758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e0c289-506e-4bb7-bdda-66b1abb361df),volume_type_id=03e0c289-506e-4bb7-bdda-66b1abb361df)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1017ee3-3cf9-42b4-af97-5ea541c695dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1017ee3-3cf9-42b4-af97-5ea541c695dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dff603f-5a91-406e-ade5-6360024c118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dff603f-5a91-406e-ade5-6360024c118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98c7203-fa1c-413f-9487-045ad0c185c0', 'volume_name': 'volume-e98c7203-fa1c-413f-9487-045ad0c185c0', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446e7282-230c-4ca5-9432-a9da16fc010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446e7282-230c-4ca5-9432-a9da16fc010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9925092-2cab-4e04-bc85-13815ce12193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:12 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Volume e98c7203-fa1c-413f-9487-045ad0c185c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98c7203-fa1c-413f-9487-045ad0c185c0', 'volume_size': 1} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:12 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.530s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:12 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Deleted volume successfully. Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d332327-d3bd-423a-be87-9f92a71e3ca9 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-30e9aafc-4ed7-4885-a777-ebcfcaea00cd-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:12 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.info" returned: 0 in 0.551s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.183s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e24df63b-9dfc-4407-9540-108135d03224,created_at=2026-04-17T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1444113142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e24df63b-9dfc-4407-9540-108135d03224,host='devstack@QuobyteHD#QuobyteHD',id=e98c7203-fa1c-413f-9487-045ad0c185c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87419caec2c7487a874d8e8a57235a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:12Z,use_quota=True,user_id='25a665a9574b469294f854991f08758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e0c289-506e-4bb7-bdda-66b1abb361df),volume_type_id=03e0c289-506e-4bb7-bdda-66b1abb361df)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Creating volume e98c7203-fa1c-413f-9487-045ad0c185c0 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:12 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:12 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 1073741824 Apr 17 15:58:12 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:12 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-44a5b92f-f4e2-4659-b1db-3d2be2a85561 tempest-VolumesDeleteCascade-1698121326 None] Create snapshot completed successfully Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-45577b0c-f4a5-4760-9d85-585f9a248e7c-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-45577b0c-f4a5-4760-9d85-585f9a248e7c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-quobyte-45577b0c-f4a5-4760-9d85-585f9a248e7c" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-45577b0c-f4a5-4760-9d85-585f9a248e7c" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aa5cef-5ab3-45db-b0ed-e1341cc0eec7]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:12 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c Apr 17 15:58:12 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:12 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 1073741824" returned: 0 in 0.520s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:12 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 Apr 17 15:58:12 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:13 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:13 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c Apr 17 15:58:13 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:13 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0" returned: 0 in 0.431s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9925092-2cab-4e04-bc85-13815ce12193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98c7203-fa1c-413f-9487-045ad0c185c0', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45f665e-c95e-4bad-b9ec-ca54ab8c4707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:13 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Volume volume-e98c7203-fa1c-413f-9487-045ad0c185c0 (e98c7203-fa1c-413f-9487-045ad0c185c0): created successfully Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45f665e-c95e-4bad-b9ec-ca54ab8c4707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Flow 'volume_create_manager' (0e9b26f1-709a-4aeb-b66e-5cc4ec8b9107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:13 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-17cbd8cf-790d-4387-91c2-33dba7f83147 tempest-GroupsTest-493144520 None] Created volume successfully. Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Creating offline snapshot 776c7e67-b4d4-4d2c-8a5f-699630d8dd61 of volume 8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f07cd95-4034-4d2c-a805-03dfa52a7a98]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:13 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 Apr 17 15:58:13 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:13 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-45577b0c-f4a5-4760-9d85-585f9a248e7c" returned: 0 in 0.433s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-45577b0c-f4a5-4760-9d85-585f9a248e7c" released by "delete_volume" :: held 0.960s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created reservations ['48d8ea36-f3bd-4521-9d0d-4a8f3dd2488e', 'b174ce4f-51ac-49f5-bede-54b493d32fe5', 'f8537f1e-718f-4f61-b492-92ce220075a5', '1f558558-8a5f-4b48-b926-d3f3ce3730fc'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:13 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:13 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-4b850984-a499-4d7f-b220-9610910830dc-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-4b850984-a499-4d7f-b220-9610910830dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-quobyte-4b850984-a499-4d7f-b220-9610910830dc" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-4b850984-a499-4d7f-b220-9610910830dc" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fd343c-e51b-46a1-a2fd-49fdd057c50a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:14 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83" returned: 0 in 0.508s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:14 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 1G Apr 17 15:58:14 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:14 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc Apr 17 15:58:14 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:14 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.511s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Deleted volume successfully. Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-efc6c2ec-81ae-4b4b-8a3f-1ddd8b8f7693 tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-45577b0c-f4a5-4760-9d85-585f9a248e7c-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:14 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc" returned: 0 in 0.543s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:14 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc Apr 17 15:58:14 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Acquiring lock "cinder-quobyte-e98c7203-fa1c-413f-9487-045ad0c185c0" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:14 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Lock "cinder-quobyte-e98c7203-fa1c-413f-9487-045ad0c185c0" acquired by "delete_volume" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 1G" returned: 0 in 0.615s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcecff2-e317-4fbe-9155-29e313a88f4b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:14 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 Apr 17 15:58:14 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:14 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 Apr 17 15:58:14 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:15 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4b850984-a499-4d7f-b220-9610910830dc" returned: 0 in 0.440s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-4b850984-a499-4d7f-b220-9610910830dc" released by "delete_volume" :: held 1.006s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created reservations ['4c7ca40b-0502-4c35-bf75-901c9fd5c1f3', 'e7e2136d-6b86-42cf-8551-fe5fcb69e09c', '0eb75476-4fc5-419d-b35d-4bb97731f386', '69855b4d-35a0-4bff-97a5-59522a3229b6'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:15 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:15 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:15 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61" returned: 0 in 0.488s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:15 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 is being set with open permissions: ugo+rw Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:15 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:15 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 Apr 17 15:58:15 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:15 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0 Apr 17 15:58:15 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:15 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61" returned: 0 in 0.403s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:15 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:15 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:15 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Deleted volume successfully. Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e98c7203-fa1c-413f-9487-045ad0c185c0" returned: 0 in 0.442s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:15 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-12cdc3c6-5e53-45b5-884b-f4cfca12bbcf tempest-VolumesDeleteCascade-1698121326 None] Create snapshot completed successfully Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Lock "cinder-quobyte-e98c7203-fa1c-413f-9487-045ad0c185c0" released by "delete_volume" :: held 0.968s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d8c85e88-fa02-41fb-bf24-77e3a66e89ac tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-4b850984-a499-4d7f-b220-9610910830dc-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Created reservations ['1001a9cf-f1e4-4ecf-aeb8-6f448bc32694'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:15 devstack cinder-volume[81996]: WARNING cinder.quota [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-450914790 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-450914790, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:15 devstack cinder-volume[81996]: WARNING cinder.quota [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-450914790 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-450914790, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Created reservations ['9ec845d1-5dc7-47b5-b1b2-50fa683b1342', '3caf5a9d-a0ea-43f6-98dd-c826f7d51716', 'd0236f7c-2965-4aad-80df-09b862f3724b', '6594389c-6e1b-4a45-95e8-7cb99fe78df1'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:15 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:15 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-7c97f564-8852-4759-855a-a3507d2c6920-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-7c97f564-8852-4759-855a-a3507d2c6920-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "cinder-quobyte-7c97f564-8852-4759-855a-a3507d2c6920" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-7c97f564-8852-4759-855a-a3507d2c6920" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:16 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[481168ae-aae0-4725-b74c-4f89bbfe36f7]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:16 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9591667a-e5c6-4bce-b757-504e46d70c63 tempest-GroupsTest-493144520 None] Delete group completed successfully. Apr 17 15:58:16 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 Apr 17 15:58:16 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Performing cascade delete. {{(pid=81996) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-776c7e67-b4d4-4d2c-8a5f-699630d8dd61-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-776c7e67-b4d4-4d2c-8a5f-699630d8dd61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:16 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-776c7e67-b4d4-4d2c-8a5f-699630d8dd61" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920" returned: 0 in 0.502s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-776c7e67-b4d4-4d2c-8a5f-699630d8dd61" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Deleting offline snapshot 776c7e67-b4d4-4d2c-8a5f-699630d8dd61 of volume 8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:58:16 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920 Apr 17 15:58:16 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] snapshot_file for this snap is: volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ef9f46-9166-4893-a65b-687c8d2384d2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:16 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 Apr 17 15:58:16 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Created reservations ['72860383-5ac6-4c7f-abe7-fd51a2f794fd'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:16 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:16 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:17 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c97f564-8852-4759-855a-a3507d2c6920" returned: 0 in 0.436s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-quobyte-7c97f564-8852-4759-855a-a3507d2c6920" released by "delete_volume" :: held 0.963s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Created reservations ['a0d90e7b-627d-4f3d-9c26-7ee96fc3170a', 'c922ac76-26d8-43a3-b51b-c018eca4c712', '70ad6369-09c2-49b4-a2b6-a3a8a3d5d4df', '2d335136-e8ae-4bae-8b78-bf5c9529f272'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:17 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:17 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:17 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61" returned: 0 in 0.522s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e0992-5151-4265-865d-9d274fe2d210]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:17 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 Apr 17 15:58:17 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:17 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.448s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-57a0e483-b7bc-4624-b50f-0b6ad733e930 tempest-GroupsTest-493144520 None] Delete group completed successfully. Apr 17 15:58:17 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.415s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Deleted volume successfully. Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2d004e30-c066-4a58-b909-8221f6794a5c tempest-CreateVolumesFromSourceVolumeTest-1538773564 None] Lock "cinder-7c97f564-8852-4759-855a-a3507d2c6920-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:17 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:17 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 Apr 17 15:58:17 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:18 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61" returned: 0 in 0.494s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:18 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61 Apr 17 15:58:18 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a1ce50e6-6831-4a3e-bd79-aa368262be56 tempest-GroupsTest-493144520 None] Group tempest-GroupsTest-Group-80559522: creating Apr 17 15:58:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a1ce50e6-6831-4a3e-bd79-aa368262be56 tempest-GroupsTest-493144520 None] Group tempest-GroupsTest-Group-80559522: created successfully Apr 17 15:58:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a1ce50e6-6831-4a3e-bd79-aa368262be56 tempest-GroupsTest-493144520 None] Create group completed successfully. Apr 17 15:58:18 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.776c7e67-b4d4-4d2c-8a5f-699630d8dd61" returned: 0 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-776c7e67-b4d4-4d2c-8a5f-699630d8dd61" released by "_delete_snapshot" :: held 2.022s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" released by "delete_snapshot" :: held 2.045s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Created reservations ['b907ccbd-c09d-43b1-8232-aa1b871d0dea', '9902b2cb-74d7-4c11-a751-81ed025893a3', '7224912d-15b3-4efe-aa92-9b6b8403adcb', 'c52828bd-48ac-4776-8ef0-dc30a02b3904'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Delete snapshot completed successfully. Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-776c7e67-b4d4-4d2c-8a5f-699630d8dd61-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-cad5b70d-9d58-41dc-9613-3ea3491f1e83-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-cad5b70d-9d58-41dc-9613-3ea3491f1e83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-cad5b70d-9d58-41dc-9613-3ea3491f1e83" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-cad5b70d-9d58-41dc-9613-3ea3491f1e83" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Deleting offline snapshot cad5b70d-9d58-41dc-9613-3ea3491f1e83 of volume 8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] snapshot_file for this snap is: volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[343f7b25-6840-4269-b825-8bf81937752d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:18 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 Apr 17 15:58:18 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:19 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83" returned: 0 in 0.544s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[311ee34b-af38-48bf-969f-3daac3bb370a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:19 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed Apr 17 15:58:19 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Flow 'volume_create_manager' (39e1524f-8053-4825-87f6-49d05efd5ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3e0e62-302b-4022-80de-8ff832ff4265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3e0e62-302b-4022-80de-8ff832ff4265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1360683339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0548cce3-752e-4ae6-a8fb-d154a9f68509,host='devstack@QuobyteHD#QuobyteHD',id=16dab1bb-f50e-4032-ad7c-1be53726e75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87419caec2c7487a874d8e8a57235a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:20Z,use_quota=True,user_id='25a665a9574b469294f854991f08758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23158947-6ca0-4c19-a153-4b08a978ba31),volume_type_id=23158947-6ca0-4c19-a153-4b08a978ba31)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62069d8e-8ea8-4316-bfce-5b5d8468d6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62069d8e-8ea8-4316-bfce-5b5d8468d6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8f8e68-1377-4a42-b513-50b5ba3d1d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8f8e68-1377-4a42-b513-50b5ba3d1d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16dab1bb-f50e-4032-ad7c-1be53726e75e', 'volume_name': 'volume-16dab1bb-f50e-4032-ad7c-1be53726e75e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04be3ea-a529-43ac-873a-ee5f7a424a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04be3ea-a529-43ac-873a-ee5f7a424a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c275b124-4d73-4949-8df5-57092a654332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:19 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Volume 16dab1bb-f50e-4032-ad7c-1be53726e75e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16dab1bb-f50e-4032-ad7c-1be53726e75e', 'volume_size': 1} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0548cce3-752e-4ae6-a8fb-d154a9f68509,created_at=2026-04-17T13:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1360683339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0548cce3-752e-4ae6-a8fb-d154a9f68509,host='devstack@QuobyteHD#QuobyteHD',id=16dab1bb-f50e-4032-ad7c-1be53726e75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87419caec2c7487a874d8e8a57235a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:20Z,use_quota=True,user_id='25a665a9574b469294f854991f08758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23158947-6ca0-4c19-a153-4b08a978ba31),volume_type_id=23158947-6ca0-4c19-a153-4b08a978ba31)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Creating volume 16dab1bb-f50e-4032-ad7c-1be53726e75e {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:19 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:19 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e 1073741824 Apr 17 15:58:19 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:19 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" returned: 0 in 0.477s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:19 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 Apr 17 15:58:19 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:20 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e 1073741824" returned: 0 in 0.516s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:20 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e Apr 17 15:58:20 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:20 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83" returned: 0 in 0.444s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:20 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83 Apr 17 15:58:20 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:20 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e" returned: 0 in 0.426s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c275b124-4d73-4949-8df5-57092a654332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16dab1bb-f50e-4032-ad7c-1be53726e75e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c08495-c33b-4a2b-a2fc-c78d87784848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:20 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Volume volume-16dab1bb-f50e-4032-ad7c-1be53726e75e (16dab1bb-f50e-4032-ad7c-1be53726e75e): created successfully Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c08495-c33b-4a2b-a2fc-c78d87784848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Flow 'volume_create_manager' (39e1524f-8053-4825-87f6-49d05efd5ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-286dce8d-e2f6-440e-983c-b35272385d36 tempest-GroupsTest-493144520 None] Created volume successfully. Apr 17 15:58:20 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed.cad5b70d-9d58-41dc-9613-3ea3491f1e83" returned: 0 in 0.442s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-cad5b70d-9d58-41dc-9613-3ea3491f1e83" released by "_delete_snapshot" :: held 1.962s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" released by "delete_snapshot" :: held 1.973s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Created reservations ['ab3ad908-9b09-4838-a20e-4b166247f244', 'a9e847b0-1feb-49e2-b86b-d1da45fbd020', '47e20af1-5312-4640-8031-0fdd37825e24', '9ac0774f-3327-4f3d-bc10-3440a801f377'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Delete snapshot completed successfully. Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-cad5b70d-9d58-41dc-9613-3ea3491f1e83-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Snapshots deleted, issuing volume delete {{(pid=81996) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47c01b-ad3c-4dea-b44b-11eef6988069]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:21 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed Apr 17 15:58:21 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:21 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" returned: 0 in 0.446s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:21 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed Apr 17 15:58:21 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:21 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" returned: 0 in 0.397s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed" released by "delete_volume" :: held 0.874s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Created reservations ['bf84226a-766f-48c6-a15c-1c7c255d4af7', '94177cad-a827-4dba-b3bc-051c69bb4174', '7ff1fd57-2fea-419e-a556-0135a45ffcd3', '576e2662-3bbd-411e-8bef-ae6aa420cb29'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:21 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:21 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Flow 'volume_create_manager' (8694af1b-5a34-456c-842c-cd8673a5a5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe98b1b-9ea7-45a2-b661-1a0ca919bbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe98b1b-9ea7-45a2-b661-1a0ca919bbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047161337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0548cce3-752e-4ae6-a8fb-d154a9f68509,host='devstack@QuobyteHD#QuobyteHD',id=48810634-e5d8-4d3b-8e19-d134f2acf252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87419caec2c7487a874d8e8a57235a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:22Z,use_quota=True,user_id='25a665a9574b469294f854991f08758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23158947-6ca0-4c19-a153-4b08a978ba31),volume_type_id=23158947-6ca0-4c19-a153-4b08a978ba31)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617283e2-8aa3-4c65-b0f8-c0943765ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617283e2-8aa3-4c65-b0f8-c0943765ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cecb339-41dd-4daa-aa67-a1df22f4e7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cecb339-41dd-4daa-aa67-a1df22f4e7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48810634-e5d8-4d3b-8e19-d134f2acf252', 'volume_name': 'volume-48810634-e5d8-4d3b-8e19-d134f2acf252', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78b81ce-3d7f-4cb2-8d4d-a01141a49aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78b81ce-3d7f-4cb2-8d4d-a01141a49aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ace377e-182c-410a-a92f-c056b658407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Volume 48810634-e5d8-4d3b-8e19-d134f2acf252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48810634-e5d8-4d3b-8e19-d134f2acf252', 'volume_size': 1} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0548cce3-752e-4ae6-a8fb-d154a9f68509,created_at=2026-04-17T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047161337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0548cce3-752e-4ae6-a8fb-d154a9f68509,host='devstack@QuobyteHD#QuobyteHD',id=48810634-e5d8-4d3b-8e19-d134f2acf252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87419caec2c7487a874d8e8a57235a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:22Z,use_quota=True,user_id='25a665a9574b469294f854991f08758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23158947-6ca0-4c19-a153-4b08a978ba31),volume_type_id=23158947-6ca0-4c19-a153-4b08a978ba31)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Creating volume 48810634-e5d8-4d3b-8e19-d134f2acf252 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:22 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:22 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 1073741824 Apr 17 15:58:22 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Flow 'volume_create_manager' (4654d974-517a-4d9a-92c1-75e2e6c3cd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4eac9d-8676-405d-9e2a-29139a6e079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4eac9d-8676-405d-9e2a-29139a6e079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1627773004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c423ef-66e6-4c2d-8a74-8643f6d67884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99443661a29d42bc9ad20ee1a5779028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:22Z,use_quota=True,user_id='525dcabc00a045c19bc0e59854114ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628526c1-b82b-47c8-970f-f2afe68527b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628526c1-b82b-47c8-970f-f2afe68527b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d59b6fc-dc7d-4a30-9ab4-555f7ee4f150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d59b6fc-dc7d-4a30-9ab4-555f7ee4f150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55c423ef-66e6-4c2d-8a74-8643f6d67884', 'volume_name': 'volume-55c423ef-66e6-4c2d-8a74-8643f6d67884', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78beacc6-fc18-4c0a-9b3f-d8cd624380e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78beacc6-fc18-4c0a-9b3f-d8cd624380e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a407a3c0-7953-4d65-9307-fab847dd0f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:22 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Volume 55c423ef-66e6-4c2d-8a74-8643f6d67884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55c423ef-66e6-4c2d-8a74-8643f6d67884', 'volume_size': 1} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:22 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.507s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:22 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Deleted volume successfully. Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-04ef1256-dcdd-4930-9b9a-142cc243b3ac tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-8b2c0b2e-66a2-4014-b5a5-8913f5d756ed-delete_volume" released by "delete_volume" :: held 5.755s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:22 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 1073741824" returned: 0 in 0.487s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:22 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 Apr 17 15:58:22 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:23 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252" returned: 0 in 0.390s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1627773004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c423ef-66e6-4c2d-8a74-8643f6d67884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99443661a29d42bc9ad20ee1a5779028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:22Z,use_quota=True,user_id='525dcabc00a045c19bc0e59854114ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Creating volume 55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:23 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ace377e-182c-410a-a92f-c056b658407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48810634-e5d8-4d3b-8e19-d134f2acf252', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef4651b-4ea1-47ec-9f96-13d740315595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:23 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 1073741824 Apr 17 15:58:23 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:23 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Volume volume-48810634-e5d8-4d3b-8e19-d134f2acf252 (48810634-e5d8-4d3b-8e19-d134f2acf252): created successfully Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef4651b-4ea1-47ec-9f96-13d740315595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Flow 'volume_create_manager' (8694af1b-5a34-456c-842c-cd8673a5a5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:23 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-bde2529e-d520-431d-bd9a-8651ab2d8006 tempest-GroupsTest-493144520 None] Created volume successfully. Apr 17 15:58:23 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 1073741824" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:23 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 Apr 17 15:58:23 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:24 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884" returned: 0 in 0.402s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a407a3c0-7953-4d65-9307-fab847dd0f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c423ef-66e6-4c2d-8a74-8643f6d67884', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9adcc0f-88ba-4bbe-af96-b235c0b81bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:24 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Volume volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 (55c423ef-66e6-4c2d-8a74-8643f6d67884): created successfully Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9adcc0f-88ba-4bbe-af96-b235c0b81bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Flow 'volume_create_manager' (4654d974-517a-4d9a-92c1-75e2e6c3cd14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-dc19ee4c-340f-4c36-a1ed-519c76901919 tempest-VolumesDeleteCascade-1698121326 None] Created volume successfully. Apr 17 15:58:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-87187f3f-1882-43ba-a5f6-1d954ed89a3d tempest-GroupsTest-493144520 None] Update group completed successfully. Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Creating offline snapshot 51d05475-380a-4ae2-a442-0b7b6a69bb0c of volume 55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c6c9d-63f1-445e-924a-393b2112def4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:24 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 Apr 17 15:58:24 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:24 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884" returned: 0 in 0.452s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:24 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c 1G Apr 17 15:58:24 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:25 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c 1G" returned: 0 in 0.503s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:25 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c Apr 17 15:58:25 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:25 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0dcc813a-b726-4e24-97dd-4624716b5d41 tempest-GroupsTest-493144520 None] Update group completed successfully. Apr 17 15:58:25 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:25 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c is being set with open permissions: ugo+rw Apr 17 15:58:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:25 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c Apr 17 15:58:25 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:26 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c" returned: 0 in 0.395s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:26 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.info Apr 17 15:58:26 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:26 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.info" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:26 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.info is being set with open permissions: ugo+rw Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:26 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.info Apr 17 15:58:26 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Acquiring lock "cinder-quobyte-16dab1bb-f50e-4032-ad7c-1be53726e75e" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Lock "cinder-quobyte-16dab1bb-f50e-4032-ad7c-1be53726e75e" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b71d7dd-9acd-4966-80b7-b6b4f16f94eb]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:26 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e Apr 17 15:58:26 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:27 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.info" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.785s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:27 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-492aa93f-0549-40b8-8fe9-77cf4fc1bed7 tempest-VolumesDeleteCascade-1698121326 None] Create snapshot completed successfully Apr 17 15:58:27 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e" returned: 0 in 0.480s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:27 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e Apr 17 15:58:27 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:27 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-16dab1bb-f50e-4032-ad7c-1be53726e75e" returned: 0 in 0.441s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Lock "cinder-quobyte-16dab1bb-f50e-4032-ad7c-1be53726e75e" released by "delete_volume" :: held 0.944s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Acquiring lock "cinder-quobyte-48810634-e5d8-4d3b-8e19-d134f2acf252" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Lock "cinder-quobyte-48810634-e5d8-4d3b-8e19-d134f2acf252" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f174fd-86bb-41fc-a14c-ed01078b9264]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Flow 'volume_create_manager' (19aaeda2-8760-4c3f-ad11-cc7567bee70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d1e724-478a-4a8d-bb47-c9aa1faa35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:27 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 Apr 17 15:58:27 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d1e724-478a-4a8d-bb47-c9aa1faa35f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1748733369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557fc6ab-ad13-4865-abb0-a33a5659f350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99443661a29d42bc9ad20ee1a5779028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=51d05475-380a-4ae2-a442-0b7b6a69bb0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:28Z,use_quota=True,user_id='525dcabc00a045c19bc0e59854114ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9ce916-4dae-418d-ad7a-404d2d690a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9ce916-4dae-418d-ad7a-404d2d690a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4c2160-a3e6-43df-8324-9c1acf404aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4c2160-a3e6-43df-8324-9c1acf404aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '557fc6ab-ad13-4865-abb0-a33a5659f350', 'volume_name': 'volume-557fc6ab-ad13-4865-abb0-a33a5659f350', 'volume_size': 1, 'snapshot_id': '51d05475-380a-4ae2-a442-0b7b6a69bb0c'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f98f1c8-5996-488a-98c4-c047e013d012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f98f1c8-5996-488a-98c4-c047e013d012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39988fc5-42b1-4067-95c6-c6bdd8d2539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:27 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Volume 557fc6ab-ad13-4865-abb0-a33a5659f350: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-557fc6ab-ad13-4865-abb0-a33a5659f350', 'volume_size': 1, 'snapshot_id': '51d05475-380a-4ae2-a442-0b7b6a69bb0c'} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-51d05475-380a-4ae2-a442-0b7b6a69bb0c-557fc6ab-ad13-4865-abb0-a33a5659f350" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-51d05475-380a-4ae2-a442-0b7b6a69bb0c-557fc6ab-ad13-4865-abb0-a33a5659f350" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Creating volume 557fc6ab-ad13-4865-abb0-a33a5659f350 from snapshot 51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-557fc6ab-ad13-4865-abb0-a33a5659f350" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-557fc6ab-ad13-4865-abb0-a33a5659f350" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] snapshot: 51d05475-380a-4ae2-a442-0b7b6a69bb0c, volume: 557fc6ab-ad13-4865-abb0-a33a5659f350, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c7a2bb-b6da-48d7-b9a1-4fcd6690bff4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:28 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c Apr 17 15:58:28 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:28 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252" returned: 0 in 0.495s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:28 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252 Apr 17 15:58:28 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:28 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55c423ef-66e6-4c2d-8a74-8643f6d67884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef8c39-5cc8-423e-b3a3-d985ca3eb5d8]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:28 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 Apr 17 15:58:28 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:28 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-48810634-e5d8-4d3b-8e19-d134f2acf252" returned: 0 in 0.417s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Lock "cinder-quobyte-48810634-e5d8-4d3b-8e19-d134f2acf252" released by "delete_volume" :: held 0.934s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Created reservations ['be59416a-3ee4-4160-a3d0-71a5273bbaee'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:28 devstack cinder-volume[81996]: WARNING cinder.quota [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1907908478 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1907908478, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:28 devstack cinder-volume[81996]: WARNING cinder.quota [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1907908478 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1907908478, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Created reservations ['08d29d58-056d-4c37-aab4-2598b0669388', '963114b9-f31e-4757-b451-b94224243e1b', '2ea3cd97-cbf2-4f3b-9f86-1ab06160d551', 'b5517405-b886-4d84-9e8c-77c1e03bf18f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:28 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Created reservations ['c9734088-2aaa-4385-8f14-d96471f02b30', '0855bd3d-c5e9-485f-8491-00905267a4ce', '535428ff-2bd4-444d-bc71-b191eb82a41c', '5185f2fc-b885-4f4c-8286-60456e8f5eac'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:29 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:29 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:29 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:29 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 Apr 17 15:58:29 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:29 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.468s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:29 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6844b186-9e5f-4c2c-8a5b-7a33f4ee64c7 tempest-GroupsTest-493144520 None] Delete group completed successfully. Apr 17 15:58:31 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350" returned: 0 in 2.227s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:31 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c845f2-9800-45b8-bc48-3ce1bbdfe047]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:31 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 Apr 17 15:58:31 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:31 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884" returned: 0 in 0.687s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:31 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:58:31 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Converted 1024.00 MB image at 459.58 MB/s Apr 17 15:58:31 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 is being set with open permissions: ugo+rw Apr 17 15:58:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:31 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 Apr 17 15:58:31 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:32 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350" returned: 0 in 0.442s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-557fc6ab-ad13-4865-abb0-a33a5659f350" released by "_copy_volume_from_snapshot" :: held 4.401s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-51d05475-380a-4ae2-a442-0b7b6a69bb0c-557fc6ab-ad13-4865-abb0-a33a5659f350" released by "_create_volume_from_snapshot" :: held 4.417s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.424s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39988fc5-42b1-4067-95c6-c6bdd8d2539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557fc6ab-ad13-4865-abb0-a33a5659f350', 'volume_size': 1, 'snapshot_id': '51d05475-380a-4ae2-a442-0b7b6a69bb0c'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb27e752-c4f1-41ac-9de5-df049f030269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:32 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Volume volume-557fc6ab-ad13-4865-abb0-a33a5659f350 (557fc6ab-ad13-4865-abb0-a33a5659f350): created successfully Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb27e752-c4f1-41ac-9de5-df049f030269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:32 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Flow 'volume_create_manager' (19aaeda2-8760-4c3f-ad11-cc7567bee70f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:32 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1da1a230-0c39-47bb-81ef-aeb9e8bd8c2d tempest-VolumesDeleteCascade-1698121326 None] Created volume successfully. Apr 17 15:58:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0430da07-0285-4a8d-8411-1b086d7bc925 tempest-GroupsV314Test-497677804 None] Group tempest-GroupsV314Test-Group-269697323: creating Apr 17 15:58:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0430da07-0285-4a8d-8411-1b086d7bc925 tempest-GroupsV314Test-497677804 None] Group tempest-GroupsV314Test-Group-269697323: created successfully Apr 17 15:58:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0430da07-0285-4a8d-8411-1b086d7bc925 tempest-GroupsV314Test-497677804 None] Create group completed successfully. Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-55c423ef-66e6-4c2d-8a74-8643f6d67884-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-55c423ef-66e6-4c2d-8a74-8643f6d67884-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Performing cascade delete. {{(pid=81996) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-51d05475-380a-4ae2-a442-0b7b6a69bb0c-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-51d05475-380a-4ae2-a442-0b7b6a69bb0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-55c423ef-66e6-4c2d-8a74-8643f6d67884" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-55c423ef-66e6-4c2d-8a74-8643f6d67884" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-51d05475-380a-4ae2-a442-0b7b6a69bb0c" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-51d05475-380a-4ae2-a442-0b7b6a69bb0c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Deleting offline snapshot 51d05475-380a-4ae2-a442-0b7b6a69bb0c of volume 55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] snapshot_file for this snap is: volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7340ad92-77ae-44bc-8ac3-84dcc763ceae]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:33 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c Apr 17 15:58:33 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:33 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c" returned: 0 in 0.456s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55c423ef-66e6-4c2d-8a74-8643f6d67884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc7bf5-e70c-4199-ae2d-0273d3bff0e8]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:33 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 Apr 17 15:58:33 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:34 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884" returned: 0 in 0.465s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:34 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c Apr 17 15:58:34 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:34 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:34 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Flow 'volume_create_manager' (f3e44553-188a-4625-b454-7a9da4705229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406c3484-24bc-421d-b64d-89864844a9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406c3484-24bc-421d-b64d-89864844a9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756097868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6f92a94-53a7-419e-bda1-ffcc44df25f6,host='devstack@QuobyteHD#QuobyteHD',id=6c532ccf-03c5-4f63-80dd-7fbcf6485323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb83b198a4dc47299732a0b4295ef41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:35Z,use_quota=True,user_id='3e420492b9d1421aaaf94ee0cb80b020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04738e98-0def-4460-9222-25e7d85a95e0),volume_type_id=04738e98-0def-4460-9222-25e7d85a95e0)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad315f-84e7-4caa-8a66-b554150abfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad315f-84e7-4caa-8a66-b554150abfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e55886-5654-4c7e-9177-e07b9d7294e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e55886-5654-4c7e-9177-e07b9d7294e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c532ccf-03c5-4f63-80dd-7fbcf6485323', 'volume_name': 'volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370e9a2f-255a-4368-b749-4dff1959819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370e9a2f-255a-4368-b749-4dff1959819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622525be-0497-4e3c-81df-b14d7d8dd97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:34 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Volume 6c532ccf-03c5-4f63-80dd-7fbcf6485323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323', 'volume_size': 1} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f6f92a94-53a7-419e-bda1-ffcc44df25f6,created_at=2026-04-17T13:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756097868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6f92a94-53a7-419e-bda1-ffcc44df25f6,host='devstack@QuobyteHD#QuobyteHD',id=6c532ccf-03c5-4f63-80dd-7fbcf6485323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb83b198a4dc47299732a0b4295ef41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:35Z,use_quota=True,user_id='3e420492b9d1421aaaf94ee0cb80b020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04738e98-0def-4460-9222-25e7d85a95e0),volume_type_id=04738e98-0def-4460-9222-25e7d85a95e0)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Creating volume 6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:34 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:34 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 1073741824 Apr 17 15:58:34 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:34 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.438s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:34 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c" returned: 0 in 0.503s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:34 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c Apr 17 15:58:34 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:35 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 1073741824" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:35 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 Apr 17 15:58:35 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:35 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884.51d05475-380a-4ae2-a442-0b7b6a69bb0c" returned: 0 in 0.417s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-51d05475-380a-4ae2-a442-0b7b6a69bb0c" released by "_delete_snapshot" :: held 1.886s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-55c423ef-66e6-4c2d-8a74-8643f6d67884" released by "delete_snapshot" :: held 1.899s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Created reservations ['5144b19d-6257-4ca2-a261-ea87cda55bbb', 'c15fa41c-192a-430f-9c11-ff7dafcc2472', 'fc92709d-ba95-4ad7-890a-ac605e529aed', '41ca5dbb-37a2-4e99-847d-c0339eb0bd64'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Delete snapshot completed successfully. Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-51d05475-380a-4ae2-a442-0b7b6a69bb0c-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Snapshots deleted, issuing volume delete {{(pid=81996) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-55c423ef-66e6-4c2d-8a74-8643f6d67884" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-55c423ef-66e6-4c2d-8a74-8643f6d67884" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bacb4a5-a8f8-4a6f-86b7-8fd9b02a708b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:35 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 Apr 17 15:58:35 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:35 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323" returned: 0 in 0.449s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622525be-0497-4e3c-81df-b14d7d8dd97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7ca91a-6917-4a8d-bb99-dda61a397441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:35 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Volume volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 (6c532ccf-03c5-4f63-80dd-7fbcf6485323): created successfully Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7ca91a-6917-4a8d-bb99-dda61a397441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Flow 'volume_create_manager' (f3e44553-188a-4625-b454-7a9da4705229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8be1e55f-8b08-4875-a2f5-0b68d07442ef tempest-GroupsV314Test-497677804 None] Created volume successfully. Apr 17 15:58:35 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:35 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884 Apr 17 15:58:35 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:36 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-55c423ef-66e6-4c2d-8a74-8643f6d67884" returned: 0 in 0.394s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-55c423ef-66e6-4c2d-8a74-8643f6d67884" released by "delete_volume" :: held 0.925s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Created reservations ['d1d1150a-6b90-4a40-9d4e-b41a7b1cd896', 'e8c93eb3-0210-413a-b029-97f9288e0bd2', 'c754b0bd-1c32-4315-a07e-4f10862459cf', '8ce0ea33-4a13-47db-a852-e5e5eef85654'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:36 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:36 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-557fc6ab-ad13-4865-abb0-a33a5659f350-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-557fc6ab-ad13-4865-abb0-a33a5659f350-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "cinder-quobyte-557fc6ab-ad13-4865-abb0-a33a5659f350" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-557fc6ab-ad13-4865-abb0-a33a5659f350" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aa5c89-881e-4c97-bbbf-20b712885c6e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:36 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 Apr 17 15:58:36 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:36 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Deleted volume successfully. Apr 17 15:58:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4e4be96c-9165-4ef8-8fbe-0ef2a0939a80 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-55c423ef-66e6-4c2d-8a74-8643f6d67884-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:37 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350" returned: 0 in 0.474s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:37 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350 Apr 17 15:58:37 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:37 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Cloning volume 6c532ccf-03c5-4f63-80dd-7fbcf6485323 to volume 61074723-946e-4cec-bde2-ba5e1dbf7f07 Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Creating offline snapshot 7bee77f5-1d00-41b3-9097-436934b6725f of volume 6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ceab1-047d-4e39-acf3-999defda5a55]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:37 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-557fc6ab-ad13-4865-abb0-a33a5659f350" returned: 0 in 0.441s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-quobyte-557fc6ab-ad13-4865-abb0-a33a5659f350" released by "delete_volume" :: held 0.937s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Created reservations ['5d70c6a9-2208-4700-9269-a116255c78a2', '360f3c77-8f89-4e74-a70a-0c54274d1b42', '454ce001-9d61-46d8-9369-f3b53817d4f4', 'ff5ce5ab-52da-4084-bc29-43062801294d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:37 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 Apr 17 15:58:37 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:37 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:37 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:38 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:38 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323" returned: 0 in 0.567s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.460s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:38 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:38 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Deleted volume successfully. Apr 17 15:58:38 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f 1G Apr 17 15:58:38 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5ad870b0-613c-4af8-8bce-f22bbfa23464 tempest-VolumesDeleteCascade-1698121326 None] Lock "cinder-557fc6ab-ad13-4865-abb0-a33a5659f350-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:38 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f 1G" returned: 0 in 0.557s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:38 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f Apr 17 15:58:38 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:39 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:39 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:58:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:39 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f Apr 17 15:58:39 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:39 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f" returned: 0 in 0.459s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:39 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.info Apr 17 15:58:39 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:40 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.info" returned: 0 in 0.458s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:40 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.info is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:40 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.info Apr 17 15:58:40 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Flow 'volume_create_manager' (503fa7aa-9235-43b0-aea9-ab9d2850eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d624b7-17c3-4bae-9a12-b465233f708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d624b7-17c3-4bae-9a12-b465233f708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-417878129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef21a5f-81b0-432e-9622-8f4fad63a456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9772251277984517a05258c88bca224c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:40Z,use_quota=True,user_id='c6fb401325124006b020f4bfae495729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6108445-4dd4-43ef-a878-581a895cf3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6108445-4dd4-43ef-a878-581a895cf3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8908dda-36f9-4605-b9f9-c913632413c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8908dda-36f9-4605-b9f9-c913632413c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef21a5f-81b0-432e-9622-8f4fad63a456', 'volume_name': 'volume-0ef21a5f-81b0-432e-9622-8f4fad63a456', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc1e5e7-c53f-40ee-8e64-b4ab1287287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc1e5e7-c53f-40ee-8e64-b4ab1287287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417454e3-e088-46bd-82a6-9cab55ab644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:40 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Volume 0ef21a5f-81b0-432e-9622-8f4fad63a456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef21a5f-81b0-432e-9622-8f4fad63a456', 'volume_size': 1} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:40 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.info" returned: 0 in 0.434s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Acquiring lock "cinder-quobyte-61074723-946e-4cec-bde2-ba5e1dbf7f07" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-61074723-946e-4cec-bde2-ba5e1dbf7f07" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] snapshot: 7bee77f5-1d00-41b3-9097-436934b6725f, volume: 61074723-946e-4cec-bde2-ba5e1dbf7f07, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b4294f-08fb-41aa-a067-76c8cebdea5a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:40 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f Apr 17 15:58:40 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:41 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f" returned: 0 in 0.493s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[519fdd0f-db35-4b86-a582-9cbd4d19c51c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:41 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 Apr 17 15:58:41 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:41 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323" returned: 0 in 0.511s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 15:58:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:41 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 Apr 17 15:58:41 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:43 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07" returned: 0 in 1.901s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:43 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad5d724-f96f-4b95-a658-a15bdc893187]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:43 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 Apr 17 15:58:43 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:44 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323" returned: 0 in 0.601s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:58:44 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Converted 1024.00 MB image at 538.03 MB/s Apr 17 15:58:44 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 is being set with open permissions: ugo+rw: NotImplementedError Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:44 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 Apr 17 15:58:44 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:44 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07" returned: 0 in 0.390s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-61074723-946e-4cec-bde2-ba5e1dbf7f07" released by "_copy_volume_from_snapshot" :: held 3.945s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Acquiring lock "cinder-quobyte-7bee77f5-1d00-41b3-9097-436934b6725f" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-7bee77f5-1d00-41b3-9097-436934b6725f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Deleting offline snapshot 7bee77f5-1d00-41b3-9097-436934b6725f of volume 6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] snapshot_file for this snap is: volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aabaa3f-efea-4488-929e-594bbbdb93bc]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:44 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f Apr 17 15:58:44 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:45 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f804c5e-a4a4-4052-abb8-02d3411d49e0]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:45 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 Apr 17 15:58:45 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:45 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323" returned: 0 in 0.452s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:45 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f Apr 17 15:58:45 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:45 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f" returned: 0 in 0.438s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:45 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f Apr 17 15:58:45 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:46 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323.7bee77f5-1d00-41b3-9097-436934b6725f" returned: 0 in 0.396s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-7bee77f5-1d00-41b3-9097-436934b6725f" released by "_delete_snapshot" :: held 1.801s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.828s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.913s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-417878129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef21a5f-81b0-432e-9622-8f4fad63a456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9772251277984517a05258c88bca224c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:40Z,use_quota=True,user_id='c6fb401325124006b020f4bfae495729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Creating volume 0ef21a5f-81b0-432e-9622-8f4fad63a456 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:46 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:46 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 1073741824 Apr 17 15:58:46 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cc17aebd-8c85-437b-a586-1213dc446611 tempest-GroupsV314Test-497677804 None] Create group from source-group-f6f92a94-53a7-419e-bda1-ffcc44df25f6 completed successfully. Apr 17 15:58:46 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 1073741824" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:46 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 Apr 17 15:58:46 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:47 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456" returned: 0 in 0.403s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417454e3-e088-46bd-82a6-9cab55ab644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef21a5f-81b0-432e-9622-8f4fad63a456', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2203aad0-6322-4b21-92ad-4e43a1d88644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:47 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Volume volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 (0ef21a5f-81b0-432e-9622-8f4fad63a456): created successfully Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2203aad0-6322-4b21-92ad-4e43a1d88644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Flow 'volume_create_manager' (503fa7aa-9235-43b0-aea9-ab9d2850eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:47 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2a8130e0-d13b-443b-93df-d16680f127c3 tempest-VolumesTransfersV355Test-671435181 None] Created volume successfully. Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Acquiring lock "cinder-quobyte-61074723-946e-4cec-bde2-ba5e1dbf7f07" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-61074723-946e-4cec-bde2-ba5e1dbf7f07" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7445b0-eea1-4843-a3fb-e3bc4d30a7be]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:47 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 Apr 17 15:58:47 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:47 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07" returned: 0 in 0.469s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:47 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07 Apr 17 15:58:47 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4b679cfd-7647-4b03-925f-f0e5ce41ff3b tempest-VolumesTransfersV355Test-1994558473 None] Transfer volume completed successfully. Apr 17 15:58:48 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-61074723-946e-4cec-bde2-ba5e1dbf7f07" returned: 0 in 0.418s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-61074723-946e-4cec-bde2-ba5e1dbf7f07" released by "delete_volume" :: held 0.913s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Created reservations ['5fb62c1a-51b4-4f07-b703-58b1ad7d5188'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:48 devstack cinder-volume[81996]: WARNING cinder.quota [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-383443206 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-383443206, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:48 devstack cinder-volume[81996]: WARNING cinder.quota [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-383443206 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-383443206, it is now deprecated. Please use the default quota class for default quota. Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Created reservations ['76819637-1c4e-4299-aadf-72f9bf34e56f', '4fa4833a-02be-4483-af66-58ca42e253d4', 'b86a5990-7e0d-4be8-aef4-0ecf3947cc6a', 'edc8fbf0-d4c7-4c30-a55b-62209451cbdd'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:48 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:48 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Acquiring lock "cinder-quobyte-6c532ccf-03c5-4f63-80dd-7fbcf6485323" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-6c532ccf-03c5-4f63-80dd-7fbcf6485323" acquired by "delete_volume" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2b9d7-c12e-4969-a985-3e81eee5a954]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:48 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 Apr 17 15:58:48 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:48 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:48 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7e8bfdfc-919a-47f9-86d0-8d2aed18afb8 tempest-GroupsV314Test-497677804 None] Delete group completed successfully. Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Acquiring lock "cinder-0ef21a5f-81b0-432e-9622-8f4fad63a456-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-0ef21a5f-81b0-432e-9622-8f4fad63a456-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Acquiring lock "cinder-quobyte-0ef21a5f-81b0-432e-9622-8f4fad63a456" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-quobyte-0ef21a5f-81b0-432e-9622-8f4fad63a456" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ede4f2-9407-4db1-8538-47ff6b230a93]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:49 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 Apr 17 15:58:49 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:49 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323" returned: 0 in 0.500s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:49 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323 Apr 17 15:58:49 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:49 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456" returned: 0 in 0.465s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:49 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456 Apr 17 15:58:49 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:49 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c532ccf-03c5-4f63-80dd-7fbcf6485323" returned: 0 in 0.403s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Lock "cinder-quobyte-6c532ccf-03c5-4f63-80dd-7fbcf6485323" released by "delete_volume" :: held 0.940s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Created reservations ['886e9e25-9f24-43b2-be6b-2512f80ae50b'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Created reservations ['8cf2f973-8e10-44bc-be64-cf2dcef86b96', 'c2ee72a9-dc92-4cd6-94e4-8effabf2e340', 'e9bae127-a99a-4f21-93e6-6c91a11d723a', '53441abd-e51e-43eb-87ec-e97f3c6d0d22'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:49 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:49 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:49 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0ef21a5f-81b0-432e-9622-8f4fad63a456" returned: 0 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-quobyte-0ef21a5f-81b0-432e-9622-8f4fad63a456" released by "delete_volume" :: held 0.939s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Created reservations ['3a3331d4-0d54-4246-aea0-7f2a72d83ae7', '2025cb5d-1817-4a7d-952c-f73977d776d0', '3c8ee84a-6326-4c82-97ee-f158f71f3591', '308e9223-a647-4a3e-bb42-27a837d98649'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:50 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:50 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:50 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.435s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:50 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a91ec408-90de-4189-856f-83729216d7ef tempest-GroupsV314Test-497677804 None] Delete group completed successfully. Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Flow 'volume_create_manager' (d9dea8f8-aa18-4bed-8986-b5f4b3c08021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7f8f8e-9dcf-4eb4-ab41-5afd1d15f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7f8f8e-9dcf-4eb4-ab41-5afd1d15f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-83197552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee2a9e3-46fb-42c2-83d1-47af8b59f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9772251277984517a05258c88bca224c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:50Z,use_quota=True,user_id='c6fb401325124006b020f4bfae495729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2425af15-a19a-498f-a37b-eeb843888d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2425af15-a19a-498f-a37b-eeb843888d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1305c425-e03f-413b-99fb-54b05e7b67c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1305c425-e03f-413b-99fb-54b05e7b67c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee2a9e3-46fb-42c2-83d1-47af8b59f569', 'volume_name': 'volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f2074b-82a8-486f-a63b-6b159d0638ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f2074b-82a8-486f-a63b-6b159d0638ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb8bb5-e0fa-4f60-859d-ba1674ad18f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:50 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Volume 9ee2a9e3-46fb-42c2-83d1-47af8b59f569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569', 'volume_size': 1} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-83197552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee2a9e3-46fb-42c2-83d1-47af8b59f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9772251277984517a05258c88bca224c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:50Z,use_quota=True,user_id='c6fb401325124006b020f4bfae495729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Creating volume 9ee2a9e3-46fb-42c2-83d1-47af8b59f569 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:50 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:50 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 1073741824 Apr 17 15:58:50 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:50 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.522s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:50 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Deleted volume successfully. Apr 17 15:58:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a0053fe6-ee4d-4459-a284-9cbdeb7557f0 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-0ef21a5f-81b0-432e-9622-8f4fad63a456-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:51 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 1073741824" returned: 0 in 0.558s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:51 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 Apr 17 15:58:51 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:51 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569" returned: 0 in 0.455s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb8bb5-e0fa-4f60-859d-ba1674ad18f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4f9b9a-4230-411a-b24d-90f9786a1954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:51 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Volume volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 (9ee2a9e3-46fb-42c2-83d1-47af8b59f569): created successfully Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4f9b9a-4230-411a-b24d-90f9786a1954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Flow 'volume_create_manager' (d9dea8f8-aa18-4bed-8986-b5f4b3c08021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9729b68d-395b-4230-811c-8785a0ac004d tempest-VolumesTransfersV355Test-671435181 None] Created volume successfully. Apr 17 15:58:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Acquiring lock "cinder-9ee2a9e3-46fb-42c2-83d1-47af8b59f569-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-9ee2a9e3-46fb-42c2-83d1-47af8b59f569-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Acquiring lock "cinder-quobyte-9ee2a9e3-46fb-42c2-83d1-47af8b59f569" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:58:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-quobyte-9ee2a9e3-46fb-42c2-83d1-47af8b59f569" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:58:52 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a8973-c730-42c3-ba9b-120f1f41b6d7]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:58:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:52 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 Apr 17 15:58:52 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:53 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:53 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569 Apr 17 15:58:53 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:53 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9ee2a9e3-46fb-42c2-83d1-47af8b59f569" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-quobyte-9ee2a9e3-46fb-42c2-83d1-47af8b59f569" released by "delete_volume" :: held 0.987s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Created reservations ['e9b505b1-d81a-4b56-a94a-ca66ff40f5d8', 'a4393648-66bd-4d0b-9c94-c1684b45f607', '84340b05-84b4-4c85-82bc-44944ffb9fca', 'ed2c8783-3e08-4a9e-9fa1-1cbb276e3ec2'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:53 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:58:53 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:54 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.428s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:54 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:58:54 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Deleted volume successfully. Apr 17 15:58:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-60e3f4bb-9960-44ce-99cd-dad8a3e39215 tempest-VolumesTransfersV355Test-285272898 None] Lock "cinder-9ee2a9e3-46fb-42c2-83d1-47af8b59f569-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Flow 'volume_create_manager' (54d5e2a6-850a-4a47-89f8-de00241e0e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae5d635-57c7-4501-b4cf-3c0d4d4d2e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae5d635-57c7-4501-b4cf-3c0d4d4d2e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2099996927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2847034-b69f-4d28-9c62-cefe3f6dacb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd6cec009ac4cad98e53d5e91915080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:58Z,use_quota=True,user_id='38a46877148742ee84e30677b0dec8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895f22b4-5346-45c7-b134-94b5a772ccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895f22b4-5346-45c7-b134-94b5a772ccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8051d275-c341-41a4-a3b9-72f4d1240c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8051d275-c341-41a4-a3b9-72f4d1240c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2847034-b69f-4d28-9c62-cefe3f6dacb9', 'volume_name': 'volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b976ac23-8efe-43f0-89f6-c4a46912b41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b976ac23-8efe-43f0-89f6-c4a46912b41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a0ea02-8e56-4163-947d-e73359f626ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:58 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Volume f2847034-b69f-4d28-9c62-cefe3f6dacb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9', 'volume_size': 1} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2099996927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2847034-b69f-4d28-9c62-cefe3f6dacb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd6cec009ac4cad98e53d5e91915080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:58:58Z,use_quota=True,user_id='38a46877148742ee84e30677b0dec8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Creating volume f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:58:58 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:58:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:58 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 1073741824 Apr 17 15:58:58 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:59 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 1073741824" returned: 0 in 0.494s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:58:59 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 Apr 17 15:58:59 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:58:59 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9" returned: 0 in 0.445s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a0ea02-8e56-4163-947d-e73359f626ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4eb3218-fe1c-4b51-8bed-7fff51ab80c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:58:59 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Volume volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 (f2847034-b69f-4d28-9c62-cefe3f6dacb9): created successfully Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4eb3218-fe1c-4b51-8bed-7fff51ab80c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:58:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Flow 'volume_create_manager' (54d5e2a6-850a-4a47-89f8-de00241e0e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:58:59 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1b9406fa-a061-428e-9fc4-938ce316618f tempest-VolumesCloneTest-1794894626 None] Created volume successfully. Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Flow 'volume_create_manager' (0ae7f6f1-d0a2-4141-8b28-2d9357e564ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a42f09-7d01-40cf-8924-c8cdf0a45c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a42f09-7d01-40cf-8924-c8cdf0a45c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1691594021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1803ab07-41dd-4e47-8072-ee100c3f7f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd6cec009ac4cad98e53d5e91915080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f2847034-b69f-4d28-9c62-cefe3f6dacb9,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:01Z,use_quota=True,user_id='38a46877148742ee84e30677b0dec8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c2914-ec4e-4c50-b589-03b29159d6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c2914-ec4e-4c50-b589-03b29159d6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144bbbf3-0f12-47f7-a0d7-8e104e11122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144bbbf3-0f12-47f7-a0d7-8e104e11122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1803ab07-41dd-4e47-8072-ee100c3f7f2e', 'volume_name': 'volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e', 'volume_size': 2, 'source_volid': 'f2847034-b69f-4d28-9c62-cefe3f6dacb9', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3f15ce-832d-4a84-85b9-7dee4e1d5fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3f15ce-832d-4a84-85b9-7dee4e1d5fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd87a8e-3ccb-4ad1-ab10-81f9c80be452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Volume 1803ab07-41dd-4e47-8072-ee100c3f7f2e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e', 'volume_size': 2, 'source_volid': 'f2847034-b69f-4d28-9c62-cefe3f6dacb9', 'source_volstatus': 'available'} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:00 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Cloning volume f2847034-b69f-4d28-9c62-cefe3f6dacb9 to volume 1803ab07-41dd-4e47-8072-ee100c3f7f2e Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Creating offline snapshot 6b78f7c0-1041-47d7-9e73-c7f839da09a8 of volume f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8ad4d8-06c8-4f65-9835-8aba655380ef]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:01 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 Apr 17 15:59:01 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:01 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9" returned: 0 in 0.554s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:01 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 1G Apr 17 15:59:01 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:02 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 1G" returned: 0 in 0.584s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:02 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 Apr 17 15:59:02 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:02 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8" returned: 0 in 0.549s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:02 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 is being set with open permissions: ugo+rw Apr 17 15:59:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:02 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 Apr 17 15:59:02 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:03 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8" returned: 0 in 0.476s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:03 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.info Apr 17 15:59:03 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:03 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.info" returned: 0 in 0.447s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:03 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.info is being set with open permissions: ugo+rw Apr 17 15:59:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:03 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.info Apr 17 15:59:03 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:04 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.info" returned: 0 in 0.456s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "cinder-quobyte-1803ab07-41dd-4e47-8072-ee100c3f7f2e" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-1803ab07-41dd-4e47-8072-ee100c3f7f2e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] snapshot: 6b78f7c0-1041-47d7-9e73-c7f839da09a8, volume: 1803ab07-41dd-4e47-8072-ee100c3f7f2e, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[324f8894-e4b7-47b8-8de9-fffe6747700a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:04 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 Apr 17 15:59:04 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:04 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8" returned: 0 in 0.498s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c94bcfb-f920-4abe-94dc-0bf29ea8f92c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:04 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 Apr 17 15:59:04 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:05 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9" returned: 0 in 0.533s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:05 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 15:59:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:05 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e Apr 17 15:59:05 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:07 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e" returned: 0 in 2.061s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d6d76-6715-4671-b15a-f7abf03d205b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:07 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 Apr 17 15:59:07 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:07 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9" returned: 0 in 0.644s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:07 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:59:07 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Converted 1024.00 MB image at 496.58 MB/s Apr 17 15:59:07 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e is being set with open permissions: ugo+rw Apr 17 15:59:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:07 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e Apr 17 15:59:07 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:08 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-1803ab07-41dd-4e47-8072-ee100c3f7f2e" released by "_copy_volume_from_snapshot" :: held 4.261s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=194,cinder:UPDATE=222,cinder:INSERT=47,cinder:DELETE=13 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "cinder-quobyte-6b78f7c0-1041-47d7-9e73-c7f839da09a8" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-6b78f7c0-1041-47d7-9e73-c7f839da09a8" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Deleting offline snapshot 6b78f7c0-1041-47d7-9e73-c7f839da09a8 of volume f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] snapshot_file for this snap is: volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e9a00e-9f0e-44dc-a704-6adbd42a62c2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:08 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 Apr 17 15:59:08 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:08 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8" returned: 0 in 0.517s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4e342c-22e9-4bd1-9e22-69c62dcc3803]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:09 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 Apr 17 15:59:09 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:09 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9" returned: 0 in 0.532s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:09 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 Apr 17 15:59:09 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:09 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8" returned: 0 in 0.509s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:09 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8 Apr 17 15:59:09 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:10 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9.6b78f7c0-1041-47d7-9e73-c7f839da09a8" returned: 0 in 0.469s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-6b78f7c0-1041-47d7-9e73-c7f839da09a8" released by "_delete_snapshot" :: held 2.077s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:UPDATE=210,cinder:DELETE=13,cinder:SELECT=166,cinder:INSERT=57 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.530s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd87a8e-3ccb-4ad1-ab10-81f9c80be452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e', 'volume_size': 2, 'source_volid': 'f2847034-b69f-4d28-9c62-cefe3f6dacb9', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fbeb10-feb2-480a-8ace-e608964c7f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:10 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Volume volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e (1803ab07-41dd-4e47-8072-ee100c3f7f2e): created successfully Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fbeb10-feb2-480a-8ace-e608964c7f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Flow 'volume_create_manager' (0ae7f6f1-d0a2-4141-8b28-2d9357e564ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e65dab83-40c5-42ca-99bd-0bf944ba6f47 tempest-VolumesCloneTest-1794894626 None] Created volume successfully. Apr 17 15:59:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "cinder-1803ab07-41dd-4e47-8072-ee100c3f7f2e-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-1803ab07-41dd-4e47-8072-ee100c3f7f2e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "cinder-quobyte-1803ab07-41dd-4e47-8072-ee100c3f7f2e" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-1803ab07-41dd-4e47-8072-ee100c3f7f2e" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:11 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e54fdf5-d503-4795-968d-f939e6293c8f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:11 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e Apr 17 15:59:11 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:12 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:12 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e Apr 17 15:59:12 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:12 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-1803ab07-41dd-4e47-8072-ee100c3f7f2e" returned: 0 in 0.440s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-1803ab07-41dd-4e47-8072-ee100c3f7f2e" released by "delete_volume" :: held 0.948s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Created reservations ['ab856065-b328-413a-90c4-b07f4e881899', 'a08903b7-2395-481d-8319-9a8ca11b8a10', 'bf3e48af-eeb2-4dba-92f8-6f8c25dbfbfa', '7d17b526-8e78-4e6b-a03f-6c75b32f1a9f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:12 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:12 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "cinder-f2847034-b69f-4d28-9c62-cefe3f6dacb9-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-f2847034-b69f-4d28-9c62-cefe3f6dacb9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "cinder-quobyte-f2847034-b69f-4d28-9c62-cefe3f6dacb9" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-f2847034-b69f-4d28-9c62-cefe3f6dacb9" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ac709-1312-40c8-80ad-1a1245d6aba2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:12 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 Apr 17 15:59:12 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:13 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.494s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:13 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Deleted volume successfully. Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67e5730b-8deb-4748-893a-0d102f4bd114 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-1803ab07-41dd-4e47-8072-ee100c3f7f2e-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:13 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9" returned: 0 in 0.472s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:13 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9 Apr 17 15:59:13 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:13 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-f2847034-b69f-4d28-9c62-cefe3f6dacb9" returned: 0 in 0.501s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-quobyte-f2847034-b69f-4d28-9c62-cefe3f6dacb9" released by "delete_volume" :: held 1.003s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Created reservations ['e4484199-6d0b-4f64-946d-4d7575867f61', '2bc45584-93f6-4d5a-8161-a157016d303c', '5a2a84fe-89a5-4502-ba0d-3694f66bf87c', '6f0f2e82-2e17-4fce-a629-b0e24fe62725'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:13 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:13 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:14 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.427s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:14 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Deleted volume successfully. Apr 17 15:59:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-28bf33fa-842d-4505-9d93-39b284e14df8 tempest-VolumesCloneTest-1794894626 None] Lock "cinder-f2847034-b69f-4d28-9c62-cefe3f6dacb9-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Flow 'volume_create_manager' (923bc003-b05d-4e5c-91c0-8b2e4911cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eb2034-a5f5-477f-9126-ef4791fe9aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eb2034-a5f5-477f-9126-ef4791fe9aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1809135295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486cbfc7-658f-420e-b765-681802fdb530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56097f483e2a4c5ba7516dc39cfe1e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:17Z,use_quota=True,user_id='c038323325b54562a3f043b4234229b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1759cf61-4516-4c88-8f11-9d2e90dc1b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1759cf61-4516-4c88-8f11-9d2e90dc1b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8465fa85-cddc-4e38-851f-832f09b5906c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.image.glance [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Creating Keystone auth plugin from conf {{(pid=81996) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8465fa85-cddc-4e38-851f-832f09b5906c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '486cbfc7-658f-420e-b765-681802fdb530', 'volume_name': 'volume-486cbfc7-658f-420e-b765-681802fdb530', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aefef8-07bb-4516-a69a-67ce02a625b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aefef8-07bb-4516-a69a-67ce02a625b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ac4fd3-ba46-4986-a2c6-4006a8b74d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:17 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Volume 486cbfc7-658f-420e-b765-681802fdb530: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-486cbfc7-658f-420e-b765-681802fdb530', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Trying to clone 486cbfc7-658f-420e-b765-681802fdb530 from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]). {{(pid=81996) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 17 15:59:17 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Image download 20.69 MB at 20.69 MB/s Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a550c8a8-06b9-4cf9-a019-17e6aeed6a70]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:17 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD Apr 17 15:59:17 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:18 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 is fetched for user c038323325b54562a3f043b4234229b5. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6298fd-a526-4e10-b573-fe2a7d610b25]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:18 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD Apr 17 15:59:18 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:18 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1809135295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486cbfc7-658f-420e-b765-681802fdb530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56097f483e2a4c5ba7516dc39cfe1e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:17Z,use_quota=True,user_id='c038323325b54562a3f043b4234229b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Creating volume 486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:18 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:18 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 1073741824 Apr 17 15:59:18 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:19 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 1073741824" returned: 0 in 0.537s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:19 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:19 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:19 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 0 in 0.439s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Attempting download of cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume 486cbfc7-658f-420e-b765-681802fdb530. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ca4011-aa6c-4191-853c-774d13c4beeb]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1___sz3rds {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:19 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1___sz3rds Apr 17 15:59:19 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:20 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1___sz3rds" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1___sz3rds {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:20 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1___sz3rds Apr 17 15:59:20 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:20 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1___sz3rds" returned: 1 in 0.449s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc5467f8-7dfc-439a-a775-b07f14ef45d1___sz3rds' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:59:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad01f9a-ae75-47cb-adc5-6e85d118c82f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:20 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD Apr 17 15:59:20 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:21 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:21 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] cc5467f8-7dfc-439a-a775-b07f14ef45d1 was qcow2, converting to raw {{(pid=81996) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 17 15:59:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:21 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:21 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:22 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 0 in 0.913s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:22 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc5467f8-7dfc-439a-a775-b07f14ef45d1_ke1ro0obdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 15:59:22 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Converted 112.00 MB image at 112.00 MB/s Apr 17 15:59:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:22 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 1G Apr 17 15:59:22 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:22 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 1G" returned: 0 in 0.536s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:22 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[194e84e0-c7d0-48f6-b7c8-2d55f962e4b5]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:22 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:22 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:23 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 0 in 0.575s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:23 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:23 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:23 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 1 in 0.515s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Downloaded image cc5467f8-7dfc-439a-a775-b07f14ef45d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}])) to volume 486cbfc7-658f-420e-b765-681802fdb530 successfully. {{(pid=81996) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Temporary image cc5467f8-7dfc-439a-a775-b07f14ef45d1 for user c038323325b54562a3f043b4234229b5 is deleted. {{(pid=81996) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.volume_utils [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Marking volume 486cbfc7-658f-420e-b765-681802fdb530 as bootable. {{(pid=81996) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Copying metadata from image cc5467f8-7dfc-439a-a775-b07f14ef45d1 to 486cbfc7-658f-420e-b765-681802fdb530. {{(pid=81996) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Creating volume glance metadata for volume 486cbfc7-658f-420e-b765-681802fdb530 backed by image cc5467f8-7dfc-439a-a775-b07f14ef45d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81996) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ac4fd3-ba46-4986-a2c6-4006a8b74d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486cbfc7-658f-420e-b765-681802fdb530', 'volume_size': 1, 'image_id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a24945d05284f37995c0101404ce894', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cc5467f8-7dfc-439a-a775-b07f14ef45d1', 'created_at': datetime.datetime(2026, 4, 17, 13, 48, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 17, 13, 48, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc5467f8-7dfc-439a-a775-b07f14ef45d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ffb6be-29dd-4e0f-8f81-c47213b7ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:23 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Volume volume-486cbfc7-658f-420e-b765-681802fdb530 (486cbfc7-658f-420e-b765-681802fdb530): created successfully Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ffb6be-29dd-4e0f-8f81-c47213b7ef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:23 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Flow 'volume_create_manager' (923bc003-b05d-4e5c-91c0-8b2e4911cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:23 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-5377781c-9e69-46d6-97db-8442ac7bb698 tempest-VolumesExtendTest-1234683461 None] Created volume successfully. Apr 17 15:59:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:24 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[590359ed-6de8-40ef-b357-1a8e0159a2ce]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:24 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:24 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:25 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 0 in 0.544s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:25 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:25 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:25 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 1 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:59:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 2G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 2G" returned: 0 in 0.044s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.111s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:25 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2a59c685-90c9-49c3-bc09-0302b8b6b877 tempest-VolumesExtendTest-1234683461 None] Extend volume completed successfully. Apr 17 15:59:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Acquiring lock "cinder-486cbfc7-658f-420e-b765-681802fdb530-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Lock "cinder-486cbfc7-658f-420e-b765-681802fdb530-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Acquiring lock "cinder-quobyte-486cbfc7-658f-420e-b765-681802fdb530" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-486cbfc7-658f-420e-b765-681802fdb530" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c7afe6-9138-4892-a01a-4c441e9d5178]: (4, 'raw') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:26 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:26 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:27 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 0 in 0.487s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:27 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:27 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:27 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 1 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530' failed. Not Retrying. {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 17 15:59:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:27 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530 Apr 17 15:59:27 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:28 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-486cbfc7-658f-420e-b765-681802fdb530" returned: 0 in 0.414s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-486cbfc7-658f-420e-b765-681802fdb530" released by "delete_volume" :: held 1.389s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Created reservations ['d85335a0-3eb1-41dc-9f01-7b4ff9657161', '70b1d0b1-089e-4990-ab49-69991e80c66c', '28aac199-155b-4263-9a39-91e9824d07ea', 'afd4308b-ed0b-47a6-acf1-abba3d1cb9d6'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:28 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:28 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:28 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.433s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:28 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Deleted volume successfully. Apr 17 15:59:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b10855f1-435a-449d-ab28-6559a6977bda tempest-VolumesExtendTest-1234683461 None] Lock "cinder-486cbfc7-658f-420e-b765-681802fdb530-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Flow 'volume_create_manager' (19efb0ea-f2e7-45b8-97b5-caec1640aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cb2be4-85de-4291-8afb-8608cec87c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cb2be4-85de-4291-8afb-8608cec87c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1571818039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979f1f3d-000b-4b93-be89-0e8d40a66e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56097f483e2a4c5ba7516dc39cfe1e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:29Z,use_quota=True,user_id='c038323325b54562a3f043b4234229b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d8d7eb-4613-4b64-b1b8-f53b9979a1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d8d7eb-4613-4b64-b1b8-f53b9979a1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabcb63b-e265-4fec-9919-4d4e4de444e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabcb63b-e265-4fec-9919-4d4e4de444e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979f1f3d-000b-4b93-be89-0e8d40a66e4e', 'volume_name': 'volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c777f71-e09c-455d-af6b-29899cf17466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c777f71-e09c-455d-af6b-29899cf17466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699ea64c-c6f9-4752-99c5-5b087dd53208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Volume 979f1f3d-000b-4b93-be89-0e8d40a66e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e', 'volume_size': 1} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1571818039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979f1f3d-000b-4b93-be89-0e8d40a66e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56097f483e2a4c5ba7516dc39cfe1e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:29Z,use_quota=True,user_id='c038323325b54562a3f043b4234229b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Creating volume 979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:29 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:29 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e 1073741824 Apr 17 15:59:29 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:29 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e 1073741824" returned: 0 in 0.479s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:29 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e Apr 17 15:59:29 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:30 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e" returned: 0 in 0.448s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699ea64c-c6f9-4752-99c5-5b087dd53208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a295fd4b-ce10-4ce8-961d-216157642bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:30 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Volume volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e (979f1f3d-000b-4b93-be89-0e8d40a66e4e): created successfully Apr 17 15:59:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a295fd4b-ce10-4ce8-961d-216157642bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Flow 'volume_create_manager' (19efb0ea-f2e7-45b8-97b5-caec1640aee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:30 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-81f1bb74-3c76-471c-b968-5e31f9a02f20 tempest-VolumesExtendTest-1234683461 None] Created volume successfully. Apr 17 15:59:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Creating offline snapshot 8bad3708-3112-432d-8c2c-674cede45c13 of volume 979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 15:59:31 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa919b19-545b-4f39-ada2-b3d44161d33f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:31 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e Apr 17 15:59:31 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:32 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e" returned: 0 in 0.510s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:32 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 1G Apr 17 15:59:32 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:32 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 1G" returned: 0 in 0.524s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:32 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 Apr 17 15:59:32 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:32 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13" returned: 0 in 0.422s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:32 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 is being set with open permissions: ugo+rw Apr 17 15:59:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:32 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 Apr 17 15:59:32 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:33 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13" returned: 0 in 0.385s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:33 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.info Apr 17 15:59:33 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:33 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.info" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:33 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.info is being set with open permissions: ugo+rw Apr 17 15:59:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:33 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.info Apr 17 15:59:33 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:34 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.info" returned: 0 in 0.418s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-dfd14330-0aba-4832-bf42-c468bf1ce9c1 tempest-VolumesExtendTest-1234683461 None] Create snapshot completed successfully Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:34 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:34 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e326d-9146-4d6b-8f3a-af6cd2d5a171]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:34 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e Apr 17 15:59:34 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:34 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.468s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:35 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e" returned: 0 in 0.523s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 2G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 2G" returned: 0 in 0.056s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.594s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:35 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-07a564eb-4008-4717-bf7b-86a7b5802f69 tempest-VolumesExtendTest-1234683461 None] Extend volume completed successfully. Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Acquiring lock "cinder-8bad3708-3112-432d-8c2c-674cede45c13-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Lock "cinder-8bad3708-3112-432d-8c2c-674cede45c13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Acquiring lock "cinder-quobyte-979f1f3d-000b-4b93-be89-0e8d40a66e4e" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-979f1f3d-000b-4b93-be89-0e8d40a66e4e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Acquiring lock "cinder-quobyte-8bad3708-3112-432d-8c2c-674cede45c13" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-8bad3708-3112-432d-8c2c-674cede45c13" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Deleting offline snapshot 8bad3708-3112-432d-8c2c-674cede45c13 of volume 979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] snapshot_file for this snap is: volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ae592e-cce0-4238-9b43-ddf612c64010]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:35 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 Apr 17 15:59:35 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:36 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13" returned: 0 in 0.524s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 15:59:36 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d75d353-3eb0-4c46-9bee-3a6095f8d1d4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:36 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e Apr 17 15:59:36 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:36 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e" returned: 0 in 0.540s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:36 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 Apr 17 15:59:36 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:37 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13" returned: 0 in 0.514s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:37 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13 Apr 17 15:59:37 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:37 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e.8bad3708-3112-432d-8c2c-674cede45c13" returned: 0 in 0.421s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-8bad3708-3112-432d-8c2c-674cede45c13" released by "_delete_snapshot" :: held 2.080s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-979f1f3d-000b-4b93-be89-0e8d40a66e4e" released by "delete_snapshot" :: held 2.093s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:37 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Created reservations ['911e94ae-77c4-4894-a0b5-8e68ed8e86c1', '482a8752-82be-442f-8f48-b239f87db611', '7c91c592-84bd-4dca-b1b1-031bf9d2b735', '225b6532-0099-49c6-9350-3956592a5783'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:37 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Delete snapshot completed successfully. Apr 17 15:59:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f9e71ddf-62be-4abf-bcc9-f3ac00b6d82a tempest-VolumesExtendTest-1234683461 None] Lock "cinder-8bad3708-3112-432d-8c2c-674cede45c13-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (ac63a0d1-9467-47ad-ae3c-487371d32b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a893ec-2017-42dd-abae-4b90e0d3dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a893ec-2017-42dd-abae-4b90e0d3dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-442469717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e6b1a5-d8eb-42e5-b619-7ee2c732374b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:39Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b47d01e-05cf-495c-84d6-e7ab7fa99a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b47d01e-05cf-495c-84d6-e7ab7fa99a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5249b4-30bc-4431-b709-c5854b67e09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5249b4-30bc-4431-b709-c5854b67e09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e6b1a5-d8eb-42e5-b619-7ee2c732374b', 'volume_name': 'volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e961eb85-3726-4a83-a47b-9750fa2a7b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e961eb85-3726-4a83-a47b-9750fa2a7b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a2cb2e-ef82-4763-9971-b7f85d0f4db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:38 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Volume 35e6b1a5-d8eb-42e5-b619-7ee2c732374b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b', 'volume_size': 1} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-442469717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e6b1a5-d8eb-42e5-b619-7ee2c732374b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:39Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Creating volume 35e6b1a5-d8eb-42e5-b619-7ee2c732374b {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:38 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:39 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b 1073741824 Apr 17 15:59:39 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Acquiring lock "cinder-979f1f3d-000b-4b93-be89-0e8d40a66e4e-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Lock "cinder-979f1f3d-000b-4b93-be89-0e8d40a66e4e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Acquiring lock "cinder-quobyte-979f1f3d-000b-4b93-be89-0e8d40a66e4e" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-979f1f3d-000b-4b93-be89-0e8d40a66e4e" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fd3bc-5519-4e1d-a060-950280250d24]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:39 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e Apr 17 15:59:39 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:39 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b 1073741824" returned: 0 in 0.525s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:39 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b Apr 17 15:59:39 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:39 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e" returned: 0 in 0.489s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:39 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e Apr 17 15:59:39 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:39 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" returned: 0 in 0.436s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a2cb2e-ef82-4763-9971-b7f85d0f4db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a913b25d-0e68-4ec1-9eec-8faef5d45c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:39 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Volume volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b (35e6b1a5-d8eb-42e5-b619-7ee2c732374b): created successfully Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a913b25d-0e68-4ec1-9eec-8faef5d45c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (ac63a0d1-9467-47ad-ae3c-487371d32b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:40 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8edb47f8-d369-4195-8b8d-437a128aa9b8 tempest-VolumesActionsTest-851234808 None] Created volume successfully. Apr 17 15:59:40 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-979f1f3d-000b-4b93-be89-0e8d40a66e4e" returned: 0 in 0.411s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Lock "cinder-quobyte-979f1f3d-000b-4b93-be89-0e8d40a66e4e" released by "delete_volume" :: held 0.950s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Created reservations ['9631c355-159c-4392-bb7f-c09dfbc86387', '0873dade-8391-4efb-a889-9ad65f72cee7', '7eabf320-26e1-4689-a3cc-48f6d1463821', 'd22d29f8-17ba-4964-a44b-85f6d68a607e'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:40 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:40 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:40 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:40 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Deleted volume successfully. Apr 17 15:59:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-17f42f4a-aaa6-405d-a311-40d0228485bd tempest-VolumesExtendTest-1234683461 None] Lock "cinder-979f1f3d-000b-4b93-be89-0e8d40a66e4e-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b91fd989-3bc2-4f9a-a2d6-e89889844225 tempest-VolumesActionsTest-851234808 None] Acquiring lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" by "attach_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b91fd989-3bc2-4f9a-a2d6-e89889844225 tempest-VolumesActionsTest-851234808 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" acquired by "attach_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b91fd989-3bc2-4f9a-a2d6-e89889844225 tempest-VolumesActionsTest-851234808 None] Attaching volume 35e6b1a5-d8eb-42e5-b619-7ee2c732374b to instance 75e954a2-6c7b-412d-8d82-4c37797efc9b at mountpoint /dev/vdb on host None. Apr 17 15:59:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b91fd989-3bc2-4f9a-a2d6-e89889844225 tempest-VolumesActionsTest-851234808 None] Attach volume completed successfully. Apr 17 15:59:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b91fd989-3bc2-4f9a-a2d6-e89889844225 tempest-VolumesActionsTest-851234808 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" released by "attach_volume" :: held 0.056s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-295135fc-5c44-48cb-bf8e-afacc558140f tempest-VolumesActionsTest-716048681 None] Terminate volume connection completed successfully. Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Flow 'volume_create_manager' (8329c02b-a2e2-4039-97a4-20541907f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b14f678-ae41-4f15-853b-1685f5677bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b14f678-ae41-4f15-853b-1685f5677bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234445946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73780672-74a4-4a83-b525-922a2e33d28a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f311f4fac4b03a8aceb54310dd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:42Z,use_quota=True,user_id='cd21c9efac594d189481a55f5a3bae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57f0f94-0a7f-46db-be43-e089385e92a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57f0f94-0a7f-46db-be43-e089385e92a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20851a68-60a5-4cd2-a3b3-c35987a61da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20851a68-60a5-4cd2-a3b3-c35987a61da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73780672-74a4-4a83-b525-922a2e33d28a', 'volume_name': 'volume-73780672-74a4-4a83-b525-922a2e33d28a', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b65f271-fae3-4a9d-8d46-0f14c50a5981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b65f271-fae3-4a9d-8d46-0f14c50a5981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69432d7d-9e59-4470-a830-89d5ad61fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:42 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Volume 73780672-74a4-4a83-b525-922a2e33d28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73780672-74a4-4a83-b525-922a2e33d28a', 'volume_size': 1} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234445946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73780672-74a4-4a83-b525-922a2e33d28a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f311f4fac4b03a8aceb54310dd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:42Z,use_quota=True,user_id='cd21c9efac594d189481a55f5a3bae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Creating volume 73780672-74a4-4a83-b525-922a2e33d28a {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:42 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:42 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a 1073741824 Apr 17 15:59:42 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-295135fc-5c44-48cb-bf8e-afacc558140f tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-detach_volume" by "detach_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-295135fc-5c44-48cb-bf8e-afacc558140f tempest-VolumesActionsTest-716048681 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:42 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-295135fc-5c44-48cb-bf8e-afacc558140f tempest-VolumesActionsTest-716048681 None] Detaching volume 35e6b1a5-d8eb-42e5-b619-7ee2c732374b from instance 75e954a2-6c7b-412d-8d82-4c37797efc9b. Apr 17 15:59:42 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-295135fc-5c44-48cb-bf8e-afacc558140f tempest-VolumesActionsTest-716048681 None] Detach volume completed successfully. Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-295135fc-5c44-48cb-bf8e-afacc558140f tempest-VolumesActionsTest-716048681 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:42 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a 1073741824" returned: 0 in 0.523s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:42 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a Apr 17 15:59:42 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:43 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a" returned: 0 in 0.416s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69432d7d-9e59-4470-a830-89d5ad61fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73780672-74a4-4a83-b525-922a2e33d28a', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ab27a0-31f6-4fe3-bb5c-0d81120b5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:43 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Volume volume-73780672-74a4-4a83-b525-922a2e33d28a (73780672-74a4-4a83-b525-922a2e33d28a): created successfully Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ab27a0-31f6-4fe3-bb5c-0d81120b5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Flow 'volume_create_manager' (8329c02b-a2e2-4039-97a4-20541907f07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-10022a85-f46e-4e09-bcd7-db7a5161d75b tempest-VolumesListTestJSON-455539048 None] Created volume successfully. Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-20ff3b38-fda1-4048-b97f-9e4f103134e6 tempest-VolumesActionsTest-851234808 None] Acquiring lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-detach_volume" by "detach_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-20ff3b38-fda1-4048-b97f-9e4f103134e6 tempest-VolumesActionsTest-851234808 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-20ff3b38-fda1-4048-b97f-9e4f103134e6 tempest-VolumesActionsTest-851234808 None] Volume detach called, but volume not attached. Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-20ff3b38-fda1-4048-b97f-9e4f103134e6 tempest-VolumesActionsTest-851234808 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-detach_volume" released by "detach_volume" :: held 0.015s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Acquiring lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Acquiring lock "cinder-quobyte-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Lock "cinder-quobyte-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d4c0b4-d9f1-47dc-abe4-bd0f508eaffd]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:43 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b Apr 17 15:59:43 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:44 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" returned: 0 in 0.512s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:44 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b Apr 17 15:59:44 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Flow 'volume_create_manager' (added8be-d7a0-4a6c-acec-76fc0d4d9b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad353bc-d2f4-4833-a291-1a4a4aa559b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad353bc-d2f4-4833-a291-1a4a4aa559b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-179468862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97540e9-095d-4196-a55e-6941999a01be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f311f4fac4b03a8aceb54310dd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:44Z,use_quota=True,user_id='cd21c9efac594d189481a55f5a3bae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322ecf14-1ea0-452b-a5de-1eeb392dc666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322ecf14-1ea0-452b-a5de-1eeb392dc666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09377e90-4345-40a3-9120-b3898acb7ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09377e90-4345-40a3-9120-b3898acb7ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97540e9-095d-4196-a55e-6941999a01be', 'volume_name': 'volume-d97540e9-095d-4196-a55e-6941999a01be', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4ea3a6-7106-4993-80af-77c57ed04679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4ea3a6-7106-4993-80af-77c57ed04679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2310f8-caf8-43af-a551-e0274bacb9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:44 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Volume d97540e9-095d-4196-a55e-6941999a01be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97540e9-095d-4196-a55e-6941999a01be', 'volume_size': 1} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-179468862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97540e9-095d-4196-a55e-6941999a01be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f311f4fac4b03a8aceb54310dd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:44Z,use_quota=True,user_id='cd21c9efac594d189481a55f5a3bae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Creating volume d97540e9-095d-4196-a55e-6941999a01be {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:44 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:44 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be 1073741824 Apr 17 15:59:44 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:44 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" returned: 0 in 0.417s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Lock "cinder-quobyte-35e6b1a5-d8eb-42e5-b619-7ee2c732374b" released by "delete_volume" :: held 0.963s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Created reservations ['44cab7d9-00aa-4602-8df4-e4151be1f038', '724d2a40-5efc-4782-8285-580e592a7ef9', '15ee3bfe-86bf-4880-a7b5-aab230d3c4a8', '62656633-7e0a-4095-9baf-bb4103c743f6'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:44 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:44 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:45 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be 1073741824" returned: 0 in 0.575s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:45 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be Apr 17 15:59:45 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:45 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.488s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:45 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Deleted volume successfully. Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-48c44cb9-a5b7-4ccb-92d2-2a615cd9a5a6 tempest-VolumesActionsTest-851234808 None] Lock "cinder-35e6b1a5-d8eb-42e5-b619-7ee2c732374b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:45 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be" returned: 0 in 0.449s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2310f8-caf8-43af-a551-e0274bacb9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97540e9-095d-4196-a55e-6941999a01be', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b600153-4fef-4e99-8568-d4a42c4da214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Volume volume-d97540e9-095d-4196-a55e-6941999a01be (d97540e9-095d-4196-a55e-6941999a01be): created successfully Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b600153-4fef-4e99-8568-d4a42c4da214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Flow 'volume_create_manager' (added8be-d7a0-4a6c-acec-76fc0d4d9b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:45 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3df4ab98-beb4-47bf-8f1c-1675c22d205b tempest-VolumesListTestJSON-455539048 None] Created volume successfully. Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Flow 'volume_create_manager' (97c33150-54f9-48a1-8a56-0766d7a201f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce16f5a8-ef6d-4d61-ae8f-671a947e4ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce16f5a8-ef6d-4d61-ae8f-671a947e4ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1961378302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eb9d60-879c-4b80-a659-4e70b607c276,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f311f4fac4b03a8aceb54310dd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:47Z,use_quota=True,user_id='cd21c9efac594d189481a55f5a3bae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0378f4-3cb2-4740-a415-0b5a8892efbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0378f4-3cb2-4740-a415-0b5a8892efbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24893c4f-964d-4a6a-9d1e-bf2a7c945ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24893c4f-964d-4a6a-9d1e-bf2a7c945ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37eb9d60-879c-4b80-a659-4e70b607c276', 'volume_name': 'volume-37eb9d60-879c-4b80-a659-4e70b607c276', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12197639-2248-4039-b3cc-48d5402ef479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12197639-2248-4039-b3cc-48d5402ef479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21f0b8c-d411-42ec-a6b3-eaab4adbd603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Volume 37eb9d60-879c-4b80-a659-4e70b607c276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37eb9d60-879c-4b80-a659-4e70b607c276', 'volume_size': 1} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1961378302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eb9d60-879c-4b80-a659-4e70b607c276,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f311f4fac4b03a8aceb54310dd02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:47Z,use_quota=True,user_id='cd21c9efac594d189481a55f5a3bae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Creating volume 37eb9d60-879c-4b80-a659-4e70b607c276 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:46 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:46 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 1073741824 Apr 17 15:59:46 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:47 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 1073741824" returned: 0 in 0.463s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:47 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 Apr 17 15:59:47 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:47 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21f0b8c-d411-42ec-a6b3-eaab4adbd603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37eb9d60-879c-4b80-a659-4e70b607c276', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabfb828-2ebc-4e0b-9aba-03078214ef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:47 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Volume volume-37eb9d60-879c-4b80-a659-4e70b607c276 (37eb9d60-879c-4b80-a659-4e70b607c276): created successfully Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabfb828-2ebc-4e0b-9aba-03078214ef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Flow 'volume_create_manager' (97c33150-54f9-48a1-8a56-0766d7a201f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:47 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b63fd91b-74ac-4f67-bd38-07dd93ca407f tempest-VolumesListTestJSON-455539048 None] Created volume successfully. Apr 17 15:59:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Acquiring lock "cinder-37eb9d60-879c-4b80-a659-4e70b607c276-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Lock "cinder-37eb9d60-879c-4b80-a659-4e70b607c276-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Acquiring lock "cinder-quobyte-37eb9d60-879c-4b80-a659-4e70b607c276" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Lock "cinder-quobyte-37eb9d60-879c-4b80-a659-4e70b607c276" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:50 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c05a45-419c-4bff-acdb-2dd2990b7c08]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:50 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 Apr 17 15:59:50 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:51 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276" returned: 0 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:51 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276 Apr 17 15:59:51 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (52d9c450-2ef5-4d56-bd8f-0d5cc5572b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd79f17b-c857-43a6-ba39-226b869bacb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd79f17b-c857-43a6-ba39-226b869bacb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-232409749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c53f132-573e-4e90-9de4-f03a36bd7599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:51Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46eb892-3d87-443a-951d-e09b5cec0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46eb892-3d87-443a-951d-e09b5cec0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b71eaf9-fe7b-4f91-984b-ad6dc0c37c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b71eaf9-fe7b-4f91-984b-ad6dc0c37c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c53f132-573e-4e90-9de4-f03a36bd7599', 'volume_name': 'volume-7c53f132-573e-4e90-9de4-f03a36bd7599', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722d7e02-b05e-4f97-856a-8091cf19039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722d7e02-b05e-4f97-856a-8091cf19039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab8e1ab-fbb3-49ca-8f9b-d7b6e8ca9804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:51 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Volume 7c53f132-573e-4e90-9de4-f03a36bd7599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c53f132-573e-4e90-9de4-f03a36bd7599', 'volume_size': 1} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-232409749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c53f132-573e-4e90-9de4-f03a36bd7599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:51Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Creating volume 7c53f132-573e-4e90-9de4-f03a36bd7599 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:51 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:51 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 1073741824 Apr 17 15:59:51 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:51 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-37eb9d60-879c-4b80-a659-4e70b607c276" returned: 0 in 0.426s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Lock "cinder-quobyte-37eb9d60-879c-4b80-a659-4e70b607c276" released by "delete_volume" :: held 0.935s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Created reservations ['0566ed3e-519c-435e-95fb-236bf31dbae9', '6c2d7453-d6f2-4f36-aa32-21571da96f3c', 'c5ebdff9-7e90-4b78-9d3d-63e96bd55ef6', '4c378873-1f74-484d-9b27-957e117957ce'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:51 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:51 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Acquiring lock "cinder-d97540e9-095d-4196-a55e-6941999a01be-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Lock "cinder-d97540e9-095d-4196-a55e-6941999a01be-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:51 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Acquiring lock "cinder-quobyte-d97540e9-095d-4196-a55e-6941999a01be" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 1073741824" returned: 0 in 0.572s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Lock "cinder-quobyte-d97540e9-095d-4196-a55e-6941999a01be" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0fbbf-9220-42c9-8759-3642c5355a94]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:51 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 Apr 17 15:59:51 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:51 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be Apr 17 15:59:51 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:52 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:52 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Deleted volume successfully. Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-a08fa3c4-681b-42d8-b8cb-61c9318a309a tempest-VolumesListTestJSON-455539048 None] Lock "cinder-37eb9d60-879c-4b80-a659-4e70b607c276-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:52 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599" returned: 0 in 0.417s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab8e1ab-fbb3-49ca-8f9b-d7b6e8ca9804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c53f132-573e-4e90-9de4-f03a36bd7599', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e144d4be-d4cc-47e7-90fa-59a27b966c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:52 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Volume volume-7c53f132-573e-4e90-9de4-f03a36bd7599 (7c53f132-573e-4e90-9de4-f03a36bd7599): created successfully Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e144d4be-d4cc-47e7-90fa-59a27b966c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (52d9c450-2ef5-4d56-bd8f-0d5cc5572b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:52 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4221676d-c07a-41f4-b021-26582aea82e1 tempest-VolumesActionsTest-851234808 None] Created volume successfully. Apr 17 15:59:52 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be" returned: 0 in 0.501s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:52 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be Apr 17 15:59:52 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:52 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d97540e9-095d-4196-a55e-6941999a01be" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Lock "cinder-quobyte-d97540e9-095d-4196-a55e-6941999a01be" released by "delete_volume" :: held 0.977s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Created reservations ['bccd0be3-e104-44b8-828f-614b3a213aa3', '2d860d85-5b45-417f-a8c1-927b9fa257db', '986c2f3d-8af9-4492-956a-488824bb9be9', '5b42bcda-e45b-45f4-886f-6515a87f2dab'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:52 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:52 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:53 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.477s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:53 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Deleted volume successfully. Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d01da0e8-8c48-47ee-bfe0-d0b281780295 tempest-VolumesListTestJSON-455539048 None] Lock "cinder-d97540e9-095d-4196-a55e-6941999a01be-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-7c53f132-573e-4e90-9de4-f03a36bd7599-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Lock "cinder-7c53f132-573e-4e90-9de4-f03a36bd7599-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-quobyte-7c53f132-573e-4e90-9de4-f03a36bd7599" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-7c53f132-573e-4e90-9de4-f03a36bd7599" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de155e0a-d29a-4ada-b7f3-31b0ae9fe947]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:53 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 Apr 17 15:59:53 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:53 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Acquiring lock "cinder-73780672-74a4-4a83-b525-922a2e33d28a-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Lock "cinder-73780672-74a4-4a83-b525-922a2e33d28a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:53 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599 Apr 17 15:59:53 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Acquiring lock "cinder-quobyte-73780672-74a4-4a83-b525-922a2e33d28a" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Lock "cinder-quobyte-73780672-74a4-4a83-b525-922a2e33d28a" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783095f-aacb-4e03-98fe-515d87ed7ad9]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:54 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a Apr 17 15:59:54 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:54 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c53f132-573e-4e90-9de4-f03a36bd7599" returned: 0 in 0.409s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-7c53f132-573e-4e90-9de4-f03a36bd7599" released by "delete_volume" :: held 0.918s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Created reservations ['a0957248-df55-43f6-b13b-55a807bbf0a5', '4cbfe0ee-6211-4f19-ad38-ac1124cc5bd4', 'f64ed0d9-d4e2-4457-9e19-d3b64e2b7735', '34af73ba-f6cb-48e2-9cf2-c02e94632e69'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:54 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:54 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:54 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a" returned: 0 in 0.476s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:54 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a Apr 17 15:59:54 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (c2177b41-6a50-4076-9972-eaddcd636eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8af7bc8-a583-49af-994f-16d64a02ddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8af7bc8-a583-49af-994f-16d64a02ddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-462380196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baafc601-eb97-4851-b531-ece3e8fc902d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:55Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f54d28b-5cd9-42aa-9804-be1f8d7b7e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f54d28b-5cd9-42aa-9804-be1f8d7b7e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c259ecd-4c98-4ef5-80e6-9f8168979463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c259ecd-4c98-4ef5-80e6-9f8168979463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baafc601-eb97-4851-b531-ece3e8fc902d', 'volume_name': 'volume-baafc601-eb97-4851-b531-ece3e8fc902d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46963b63-48cd-4eae-ba4f-941d14ad1bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46963b63-48cd-4eae-ba4f-941d14ad1bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfadb7bc-3220-40a0-a185-7a7da118e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:54 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Volume baafc601-eb97-4851-b531-ece3e8fc902d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baafc601-eb97-4851-b531-ece3e8fc902d', 'volume_size': 1} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-462380196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baafc601-eb97-4851-b531-ece3e8fc902d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:55Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Creating volume baafc601-eb97-4851-b531-ece3e8fc902d {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:54 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:54 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d 1073741824 Apr 17 15:59:54 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:54 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.469s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:54 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Deleted volume successfully. Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-160b01f0-8e25-48ae-b0f6-e8f50c25c51b tempest-VolumesActionsTest-716048681 None] Lock "cinder-7c53f132-573e-4e90-9de4-f03a36bd7599-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:54 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-73780672-74a4-4a83-b525-922a2e33d28a" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Lock "cinder-quobyte-73780672-74a4-4a83-b525-922a2e33d28a" released by "delete_volume" :: held 0.950s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:54 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Created reservations ['b781d917-04c9-4465-9d17-3e09a442eafc', '259b739d-cf8c-4126-ae84-c7c48f6d0fd5', 'f2373262-3b03-4f56-914a-68afc2bbc7b6', '6f463b4a-7963-469f-804b-fd34439ef832'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:55 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:55 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:55 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d 1073741824" returned: 0 in 0.567s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:55 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d Apr 17 15:59:55 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:55 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.470s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Deleted volume successfully. Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-613f1494-37a9-4f3b-bcb5-98a2e8e68f8c tempest-VolumesListTestJSON-455539048 None] Lock "cinder-73780672-74a4-4a83-b525-922a2e33d28a-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:55 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d" returned: 0 in 0.488s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfadb7bc-3220-40a0-a185-7a7da118e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baafc601-eb97-4851-b531-ece3e8fc902d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac3abc5-e534-4e93-8bb3-8d5a44eb7238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:55 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Volume volume-baafc601-eb97-4851-b531-ece3e8fc902d (baafc601-eb97-4851-b531-ece3e8fc902d): created successfully Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac3abc5-e534-4e93-8bb3-8d5a44eb7238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (c2177b41-6a50-4076-9972-eaddcd636eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-268db2ef-da0a-4151-b9c4-45a18c1fcd97 tempest-VolumesActionsTest-851234808 None] Created volume successfully. Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (4ad068b0-195a-4553-bf0d-a9fd8b8e41a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd05183-deba-4bbe-ab5e-b896d2592392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd05183-deba-4bbe-ab5e-b896d2592392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47297741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:57Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43b6b98-2eaf-4ae2-bf69-ecf1f80453a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43b6b98-2eaf-4ae2-bf69-ecf1f80453a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f762f5-8c58-48d1-9012-0ac64f626976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f762f5-8c58-48d1-9012-0ac64f626976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d', 'volume_name': 'volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2486d975-6b9d-40a1-ab74-af5bb77ccd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2486d975-6b9d-40a1-ab74-af5bb77ccd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a494bd7-a165-4d21-8333-d281d38972e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Volume b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d', 'volume_size': 1} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47297741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:57Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Creating volume b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:56 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:56 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d 1073741824 Apr 17 15:59:56 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (d27b9ba6-72ea-49f5-81a1-00a8173b078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbd8a9f-d82b-4c01-87d2-4bcb3037092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbd8a9f-d82b-4c01-87d2-4bcb3037092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278915783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7af728a-38ca-4bd8-a78e-309888ddd215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:57Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18950c0-e65f-4ca8-a6e7-6928f6a9c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18950c0-e65f-4ca8-a6e7-6928f6a9c553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bab005-02b5-4d7d-bff0-2d222a01d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bab005-02b5-4d7d-bff0-2d222a01d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7af728a-38ca-4bd8-a78e-309888ddd215', 'volume_name': 'volume-a7af728a-38ca-4bd8-a78e-309888ddd215', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798f067e-b178-40ef-9dde-844095ebdb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798f067e-b178-40ef-9dde-844095ebdb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885c3265-00d5-40fa-850e-7ec7b7eb5420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:56 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Volume a7af728a-38ca-4bd8-a78e-309888ddd215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7af728a-38ca-4bd8-a78e-309888ddd215', 'volume_size': 1} Apr 17 15:59:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-baafc601-eb97-4851-b531-ece3e8fc902d-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Lock "cinder-baafc601-eb97-4851-b531-ece3e8fc902d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:57 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (55ce28cf-f1c1-4a01-9468-31e50393ad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890adcda-6004-443e-bcee-e47e61957c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-quobyte-baafc601-eb97-4851-b531-ece3e8fc902d" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890adcda-6004-443e-bcee-e47e61957c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1019868970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1468516-470d-4079-9129-41b93e6886a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:57Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67d64ff-d5c2-4fac-a9a9-fbd276db8a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67d64ff-d5c2-4fac-a9a9-fbd276db8a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec77d8fd-7951-4c13-8edb-13ef0229b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec77d8fd-7951-4c13-8edb-13ef0229b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1468516-470d-4079-9129-41b93e6886a7', 'volume_name': 'volume-c1468516-470d-4079-9129-41b93e6886a7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3a070b-829b-48ab-ab35-1451dddffa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3a070b-829b-48ab-ab35-1451dddffa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bc11b5-8077-4cf9-a35b-2f6e1fa7a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Volume c1468516-470d-4079-9129-41b93e6886a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1468516-470d-4079-9129-41b93e6886a7', 'volume_size': 1} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d 1073741824" returned: 0 in 0.655s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-baafc601-eb97-4851-b531-ece3e8fc902d" acquired by "delete_volume" :: waited 0.063s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f0585c-7535-4bd9-bef1-98061ce92919]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:57 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d Apr 17 15:59:57 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:57 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d Apr 17 15:59:57 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (ce37dcf1-4a8c-43d8-b62d-deaae16ecf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0d411d-b707-453b-89d4-8d2660b3832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0d411d-b707-453b-89d4-8d2660b3832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262583789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0175e9de-59ac-4879-850b-4a7246b49f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:58Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03883470-1016-4bc4-b1f0-a4308718d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03883470-1016-4bc4-b1f0-a4308718d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e993948e-fd46-445c-85f6-6396a9631df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e993948e-fd46-445c-85f6-6396a9631df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0175e9de-59ac-4879-850b-4a7246b49f7d', 'volume_name': 'volume-0175e9de-59ac-4879-850b-4a7246b49f7d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08816a68-5b35-4fbd-84e1-63eae73ffa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08816a68-5b35-4fbd-84e1-63eae73ffa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac114f-d0c6-424d-87b4-023f056a3a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Volume 0175e9de-59ac-4879-850b-4a7246b49f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0175e9de-59ac-4879-850b-4a7246b49f7d', 'volume_size': 1} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (030b6a52-4117-48d1-9354-609c2c36f3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a47dd07-366b-4b82-90d1-c45a2ac8dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a47dd07-366b-4b82-90d1-c45a2ac8dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837526143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1cf876-f3ff-43cc-b1cc-854b5c9aad30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:58Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10a7f5f-8dbb-4699-9005-c757d7208d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10a7f5f-8dbb-4699-9005-c757d7208d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4831264-bbd0-46e6-8905-2cf03d238feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4831264-bbd0-46e6-8905-2cf03d238feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1cf876-f3ff-43cc-b1cc-854b5c9aad30', 'volume_name': 'volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6afe164-b812-4fa9-8cd1-b4d4766e0c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6afe164-b812-4fa9-8cd1-b4d4766e0c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8c33ca-02b6-4c5e-9b12-57f0e6c1264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Volume 9e1cf876-f3ff-43cc-b1cc-854b5c9aad30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30', 'volume_size': 1} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:57 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278915783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7af728a-38ca-4bd8-a78e-309888ddd215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:57Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Creating volume a7af728a-38ca-4bd8-a78e-309888ddd215 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:57 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a494bd7-a165-4d21-8333-d281d38972e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 1073741824 Apr 17 15:59:57 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401c6832-fe7f-49a6-8833-8dd622c28ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Volume volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d (b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d): created successfully Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401c6832-fe7f-49a6-8833-8dd622c28ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:57 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (4ad068b0-195a-4553-bf0d-a9fd8b8e41a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d" returned: 0 in 0.547s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:57 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-49864267-32f3-427f-8c2e-fbdd2f3c625d tempest-CreateVolumesFromImageTest-1983954093 None] Created volume successfully. Apr 17 15:59:57 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d Apr 17 15:59:57 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:58 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-baafc601-eb97-4851-b531-ece3e8fc902d" returned: 0 in 0.432s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:58 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 1073741824" returned: 0 in 0.490s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-baafc601-eb97-4851-b531-ece3e8fc902d" released by "delete_volume" :: held 1.013s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:58 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 Apr 17 15:59:58 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Created reservations ['b8f2682c-de20-434e-bb67-1b8d9b197a67', '2e86a076-1eb5-4dc4-b9a6-fef6ce7bb450', '3297dd8d-d577-4a8c-baeb-d924e0fde7ee', '73b4eba5-e2bd-451d-bd76-e0aff7fd2e0d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:58 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 15:59:58 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:58 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215" returned: 0 in 0.433s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1019868970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1468516-470d-4079-9129-41b93e6886a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:57Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Creating volume c1468516-470d-4079-9129-41b93e6886a7 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:58 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885c3265-00d5-40fa-850e-7ec7b7eb5420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7af728a-38ca-4bd8-a78e-309888ddd215', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:58 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 1073741824 Apr 17 15:59:58 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce48b72-bbcf-4511-ba40-7a3bc0a8aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:58 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Volume volume-a7af728a-38ca-4bd8-a78e-309888ddd215 (a7af728a-38ca-4bd8-a78e-309888ddd215): created successfully Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce48b72-bbcf-4511-ba40-7a3bc0a8aacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (d27b9ba6-72ea-49f5-81a1-00a8173b078b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-71f8f0cc-5ffb-4a4c-a525-7e6269942b35 tempest-CreateVolumesFromImageTest-1983954093 None] Created volume successfully. Apr 17 15:59:58 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.429s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 15:59:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Deleted volume successfully. Apr 17 15:59:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-cfc57a36-7c5f-43f7-8b34-e0aa699e6b54 tempest-VolumesActionsTest-716048681 None] Lock "cinder-baafc601-eb97-4851-b531-ece3e8fc902d-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 15:59:59 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 1073741824" returned: 0 in 0.474s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:59 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 Apr 17 15:59:59 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (9d14dea2-bda9-40e0-b21f-994631af871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe36e09-25ee-4882-9a54-f6dd6ecda1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe36e09-25ee-4882-9a54-f6dd6ecda1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1400100721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:00Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598ddc2-6afd-4289-aec6-116c6461274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598ddc2-6afd-4289-aec6-116c6461274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288c528-d4ad-4f52-89d8-920be9b37976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288c528-d4ad-4f52-89d8-920be9b37976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7', 'volume_name': 'volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017fc398-c775-4d53-b08e-12868e8a16fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017fc398-c775-4d53-b08e-12868e8a16fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69270e07-99e1-4a0e-9c1b-23f6e312d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:59 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Volume 5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7', 'volume_size': 1} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:59 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7" returned: 0 in 0.447s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262583789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0175e9de-59ac-4879-850b-4a7246b49f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:58Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Creating volume 0175e9de-59ac-4879-850b-4a7246b49f7d {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 15:59:59 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bc11b5-8077-4cf9-a35b-2f6e1fa7a366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1468516-470d-4079-9129-41b93e6886a7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:59 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d 1073741824 Apr 17 15:59:59 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3181abb9-6724-4df6-878b-ffd1fe17e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 15:59:59 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Volume volume-c1468516-470d-4079-9129-41b93e6886a7 (c1468516-470d-4079-9129-41b93e6886a7): created successfully Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3181abb9-6724-4df6-878b-ffd1fe17e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 15:59:59 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (55ce28cf-f1c1-4a01-9468-31e50393ad4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 15:59:59 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0c55dc74-b7c4-40e8-a486-0ed791b811ac tempest-CreateVolumesFromImageTest-1983954093 None] Created volume successfully. Apr 17 16:00:00 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d 1073741824" returned: 0 in 0.469s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:00 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d Apr 17 16:00:00 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:00 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d" returned: 0 in 0.403s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837526143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1cf876-f3ff-43cc-b1cc-854b5c9aad30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5c10cf00444f2992b349cd9b17485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T13:59:58Z,use_quota=True,user_id='f388bc6a31e14d6b80519ecdf251bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Creating volume 9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:00 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac114f-d0c6-424d-87b4-023f056a3a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0175e9de-59ac-4879-850b-4a7246b49f7d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:00 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 1073741824 Apr 17 16:00:00 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ab0cc9-f5cd-463a-8fb5-ff8eeb0f1b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Volume volume-0175e9de-59ac-4879-850b-4a7246b49f7d (0175e9de-59ac-4879-850b-4a7246b49f7d): created successfully Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ab0cc9-f5cd-463a-8fb5-ff8eeb0f1b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (ce37dcf1-4a8c-43d8-b62d-deaae16ecf63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:00 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-49f7d594-3bfe-4e95-ba0b-7cd77742d44d tempest-CreateVolumesFromImageTest-1983954093 None] Created volume successfully. Apr 17 16:00:01 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 1073741824" returned: 0 in 0.472s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:01 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 Apr 17 16:00:01 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:01 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30" returned: 0 in 0.403s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1400100721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:00Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Creating volume 5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:01 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8c33ca-02b6-4c5e-9b12-57f0e6c1264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:01 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 1073741824 Apr 17 16:00:01 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9648e37d-7d21-4441-bf8a-22464a6b5b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Volume volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 (9e1cf876-f3ff-43cc-b1cc-854b5c9aad30): created successfully Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9648e37d-7d21-4441-bf8a-22464a6b5b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Flow 'volume_create_manager' (030b6a52-4117-48d1-9354-609c2c36f3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:01 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-387d1c76-4b2a-4a0a-aae2-7852f3ea7fd7 tempest-CreateVolumesFromImageTest-1983954093 None] Created volume successfully. Apr 17 16:00:02 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 1073741824" returned: 0 in 0.499s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:02 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 Apr 17 16:00:02 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-quobyte-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae1948b-d53d-421a-bf41-ba8f67608697]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:02 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 Apr 17 16:00:02 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:02 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7" returned: 0 in 0.420s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69270e07-99e1-4a0e-9c1b-23f6e312d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a52eca-5fb7-474e-8218-aed7456b92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:02 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Volume volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 (5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7): created successfully Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a52eca-5fb7-474e-8218-aed7456b92ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (9d14dea2-bda9-40e0-b21f-994631af871f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:02 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-20baef2d-184f-46e2-a285-f8cc79e4b9f6 tempest-VolumesActionsTest-851234808 None] Created volume successfully. Apr 17 16:00:02 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30" returned: 0 in 0.502s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:02 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30 Apr 17 16:00:02 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Lock "cinder-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-quobyte-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8225d8-204d-46f5-96f3-37714523f08e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:03 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 Apr 17 16:00:03 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:03 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30" released by "delete_volume" :: held 0.977s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Created reservations ['19f08ed6-079e-4a2e-967e-09c59d1e9077', 'c0e644e1-22a9-4ae8-9138-a17ed4975240', '77d2f5f4-2048-44d0-ab09-00fb81cd4ba5', '5bcf1b43-b102-418e-b9ab-31cfcc630c0c'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:03 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:03 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:03 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:03 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7 Apr 17 16:00:03 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:03 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.399s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:03 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Deleted volume successfully. Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-61c6b62c-9a2c-4ffa-9a91-a27218642c36 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-9e1cf876-f3ff-43cc-b1cc-854b5c9aad30-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:03 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7" returned: 0 in 0.408s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7" released by "delete_volume" :: held 0.893s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Created reservations ['450ce312-ce55-4d93-a76c-07d54c013e47', '09fb7446-ff6d-4751-a472-2de028ead3df', 'b2f89718-d985-4fce-81ca-6b4b98a4a178', '929982aa-5f36-4133-b092-55215f086287'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:03 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:03 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-0175e9de-59ac-4879-850b-4a7246b49f7d-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:04 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (1d05162c-f1d9-4c4f-a5e4-1818d1803fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a2f9f5-6e6d-412e-a65d-f7c9b47ed600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-0175e9de-59ac-4879-850b-4a7246b49f7d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.469s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a2f9f5-6e6d-412e-a65d-f7c9b47ed600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632628335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff7ca31-d52b-49dc-b13a-da182cad79fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:04Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee279d34-cfb0-49b8-bf0b-2ea8b715bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee279d34-cfb0-49b8-bf0b-2ea8b715bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434f2108-29cb-4614-a4cb-72e7b8b1731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434f2108-29cb-4614-a4cb-72e7b8b1731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff7ca31-d52b-49dc-b13a-da182cad79fd', 'volume_name': 'volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7ae7a7-45c7-4326-95af-077359b25a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7ae7a7-45c7-4326-95af-077359b25a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc12fdd-9f1d-459c-b62d-234b6b48fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:04 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Volume 6ff7ca31-d52b-49dc-b13a-da182cad79fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd', 'volume_size': 1} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632628335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff7ca31-d52b-49dc-b13a-da182cad79fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:04Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Creating volume 6ff7ca31-d52b-49dc-b13a-da182cad79fd {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:04 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:04 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Deleted volume successfully. Apr 17 16:00:04 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd 1073741824 Apr 17 16:00:04 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-4ff2208c-82b1-4d02-bfed-3d4490a87a47 tempest-VolumesActionsTest-716048681 None] Lock "cinder-5d2ba86d-d7e2-4e2a-9621-6273a7c6a0e7-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-quobyte-0175e9de-59ac-4879-850b-4a7246b49f7d" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-0175e9de-59ac-4879-850b-4a7246b49f7d" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6dc7c-2326-4c05-82d7-bfa3651dd66b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:04 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d Apr 17 16:00:04 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:04 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd 1073741824" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:04 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd Apr 17 16:00:04 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:05 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d" returned: 0 in 0.501s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:05 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d Apr 17 16:00:05 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:05 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd" returned: 0 in 0.398s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc12fdd-9f1d-459c-b62d-234b6b48fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e453be1-1a50-4250-a0f8-37c42817f25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:05 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0175e9de-59ac-4879-850b-4a7246b49f7d" returned: 0 in 0.434s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:05 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Volume volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd (6ff7ca31-d52b-49dc-b13a-da182cad79fd): created successfully Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e453be1-1a50-4250-a0f8-37c42817f25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (1d05162c-f1d9-4c4f-a5e4-1818d1803fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-0175e9de-59ac-4879-850b-4a7246b49f7d" released by "delete_volume" :: held 0.966s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d916ffb8-9933-43de-baf8-0eaede95eb0c tempest-VolumesActionsTest-851234808 None] Created volume successfully. Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Created reservations ['84397346-669c-4acf-a7a9-c265e66657e6', 'ec309470-84f4-4fe2-946f-95ae681e2ab0', '826302c4-fb1a-4cbe-a25c-00d78d44fb9e', '3d8d3f3d-368e-4e8e-bb26-da8a9587f3a4'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:05 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:05 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:05 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.394s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Deleted volume successfully. Apr 17 16:00:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-683033df-5b1c-4b21-ad6c-11b8b5096141 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-0175e9de-59ac-4879-850b-4a7246b49f7d-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-c1468516-470d-4079-9129-41b93e6886a7-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-c1468516-470d-4079-9129-41b93e6886a7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-quobyte-c1468516-470d-4079-9129-41b93e6886a7" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-c1468516-470d-4079-9129-41b93e6886a7" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b38301-0129-49a1-8868-612e761a72c1]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-6ff7ca31-d52b-49dc-b13a-da182cad79fd-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Lock "cinder-6ff7ca31-d52b-49dc-b13a-da182cad79fd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Acquiring lock "cinder-quobyte-6ff7ca31-d52b-49dc-b13a-da182cad79fd" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-6ff7ca31-d52b-49dc-b13a-da182cad79fd" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b87c59-3ab4-4a9e-a4fb-3dcfc5d5dde3]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:06 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 Apr 17 16:00:06 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:06 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd Apr 17 16:00:06 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:07 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7" returned: 0 in 0.480s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:07 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7 Apr 17 16:00:07 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:07 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:07 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd Apr 17 16:00:07 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:07 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c1468516-470d-4079-9129-41b93e6886a7" returned: 0 in 0.396s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-c1468516-470d-4079-9129-41b93e6886a7" released by "delete_volume" :: held 0.897s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Created reservations ['d62aac72-b0e7-4973-8755-192e2584ec69', '9705ff30-765e-4e03-9d33-1cfdef57535f', '3ae34cd5-3e11-4411-8b8e-a6662df3415b', 'cf4729d8-cfde-4bc0-aeb4-6c0a34724269'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:07 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6ff7ca31-d52b-49dc-b13a-da182cad79fd" returned: 0 in 0.426s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Lock "cinder-quobyte-6ff7ca31-d52b-49dc-b13a-da182cad79fd" released by "delete_volume" :: held 0.915s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:07 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:07 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Created reservations ['486db404-9821-43ca-a0a4-64940001b0b7', 'cc7f3376-826f-47d6-999c-a36da0eb3584', '11c60087-e5b9-4518-89af-5bc41c46e4cb', '00c3db06-3a59-4496-b276-6ad6390ac20b'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-a7af728a-38ca-4bd8-a78e-309888ddd215-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-a7af728a-38ca-4bd8-a78e-309888ddd215-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-quobyte-a7af728a-38ca-4bd8-a78e-309888ddd215" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:07 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:07 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-a7af728a-38ca-4bd8-a78e-309888ddd215" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[427a9bac-99b5-430b-b3f7-7c2015e8a7b6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:07 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 Apr 17 16:00:07 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:08 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Deleted volume successfully. Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-35ab97f6-768b-4c14-a9c8-641cd5a82d89 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-c1468516-470d-4079-9129-41b93e6886a7-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (f0246502-456d-4f3b-ad62-fcdb36840097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14f9885-deb7-4611-8919-ab28cf9cea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14f9885-deb7-4611-8919-ab28cf9cea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1050094691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e444b520-058f-4e06-a2a3-b56aff724dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:08Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74325f31-e8e2-490b-b21b-ba625df41125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74325f31-e8e2-490b-b21b-ba625df41125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4fc6f4-a6bd-4b59-b77d-d58903028912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4fc6f4-a6bd-4b59-b77d-d58903028912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e444b520-058f-4e06-a2a3-b56aff724dfd', 'volume_name': 'volume-e444b520-058f-4e06-a2a3-b56aff724dfd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36da5535-b870-4302-b6b1-3e701e57c8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36da5535-b870-4302-b6b1-3e701e57c8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13348c0-558b-4aad-a8dc-8d0859e452fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:08 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Volume e444b520-058f-4e06-a2a3-b56aff724dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e444b520-058f-4e06-a2a3-b56aff724dfd', 'volume_size': 1} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1050094691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e444b520-058f-4e06-a2a3-b56aff724dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d61cf0fd9884d659eaf05b839af602c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:08Z,use_quota=True,user_id='b7885bd4e2c14410a55fa377dfa45b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Creating volume e444b520-058f-4e06-a2a3-b56aff724dfd {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:08 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:08 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd 1073741824 Apr 17 16:00:08 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:08 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.541s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Deleted volume successfully. Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-c6cd4cbe-7160-4302-82f6-3d645e202546 tempest-VolumesActionsTest-716048681 None] Lock "cinder-6ff7ca31-d52b-49dc-b13a-da182cad79fd-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:08 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215" returned: 0 in 0.538s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:08 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215 Apr 17 16:00:08 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:08 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd 1073741824" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:UPDATE=183,cinder:SELECT=147,cinder:INSERT=62,cinder:DELETE=16 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:08 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd Apr 17 16:00:08 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:08 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a7af728a-38ca-4bd8-a78e-309888ddd215" returned: 0 in 0.458s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-a7af728a-38ca-4bd8-a78e-309888ddd215" released by "delete_volume" :: held 1.030s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Created reservations ['a6934965-3e71-4ebc-bea4-364cefc5487c', '76ed5de8-09e5-4935-907e-fd3f47ab8e04', 'ad81c3c2-809f-4729-8f0a-6ecaee6b2c18', '3114edc1-cab3-4397-988e-1b0388a4afa8'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:08 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:08 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:09 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13348c0-558b-4aad-a8dc-8d0859e452fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e444b520-058f-4e06-a2a3-b56aff724dfd', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01104373-4f1e-4c3f-9a07-b57a6f0093d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:09 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Volume volume-e444b520-058f-4e06-a2a3-b56aff724dfd (e444b520-058f-4e06-a2a3-b56aff724dfd): created successfully Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01104373-4f1e-4c3f-9a07-b57a6f0093d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Flow 'volume_create_manager' (f0246502-456d-4f3b-ad62-fcdb36840097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-c8588f40-20bc-4801-8ea1-8e827d91fa8a tempest-VolumesActionsTest-851234808 None] Created volume successfully. Apr 17 16:00:09 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Deleted volume successfully. Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-62fb62be-32d3-4a8f-bf3e-12712c7ff0aa tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-a7af728a-38ca-4bd8-a78e-309888ddd215-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "cinder-quobyte-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c092bd-1e9a-4082-8d94-95001cc68479]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:09 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d Apr 17 16:00:09 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:10 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d" returned: 0 in 0.529s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:10 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d Apr 17 16:00:10 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Acquiring lock "cinder-e444b520-058f-4e06-a2a3-b56aff724dfd-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Lock "cinder-e444b520-058f-4e06-a2a3-b56aff724dfd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:UPDATE=201,cinder:SELECT=132,cinder:INSERT=38,cinder:DELETE=18 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Acquiring lock "cinder-quobyte-e444b520-058f-4e06-a2a3-b56aff724dfd" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Lock "cinder-quobyte-e444b520-058f-4e06-a2a3-b56aff724dfd" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae98a0d-1cc3-4de3-b062-1152010386fd]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:10 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd Apr 17 16:00:10 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:10 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-quobyte-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d" released by "delete_volume" :: held 1.002s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Created reservations ['f9d21eb2-fdb2-43b8-a871-b0df8aa615fd', '34ed548b-0fa4-404f-9b8e-23769357e3a2', '516b4233-d155-4317-8d8a-2dfc184f2735', '220642cc-63fc-43aa-9176-c09b6573b6f2'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:10 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:10 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:11 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd" returned: 0 in 0.495s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:11 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd Apr 17 16:00:11 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:11 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.427s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:11 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Deleted volume successfully. Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e08e3567-595a-407d-99e1-be37aab233a5 tempest-CreateVolumesFromImageTest-1983954093 None] Lock "cinder-b3a99d7b-fc43-45e9-b7f9-6d657cdaec2d-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:11 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e444b520-058f-4e06-a2a3-b56aff724dfd" returned: 0 in 0.418s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Lock "cinder-quobyte-e444b520-058f-4e06-a2a3-b56aff724dfd" released by "delete_volume" :: held 0.931s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Created reservations ['69a4d612-b10c-42ed-ae66-8d5b4621610b', '779100a2-925a-4926-ad19-bfa9850ac0e6', 'a1bb90b6-fc34-4bef-b707-fe03feea6c14', '6f8f8e39-56cb-46d3-8b75-b35aef124795'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:11 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:11 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:12 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.503s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:12 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:12 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Deleted volume successfully. Apr 17 16:00:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-99c73e7e-063d-4705-90b0-c04ca867ea52 tempest-VolumesActionsTest-851234808 None] Lock "cinder-e444b520-058f-4e06-a2a3-b56aff724dfd-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (5e9d5fe8-b252-4f89-9288-76738b74312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff77d0a-99b3-40cf-a361-5a8bee5c3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff77d0a-99b3-40cf-a361-5a8bee5c3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1238912698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80322ed4-f16d-405d-a74f-3551d00c41b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac4ce5bd6044d42ac1aca411487278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:14Z,use_quota=True,user_id='37a980d9c8804a828dbb8729ab796b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ebf407-48da-4967-829d-77749df78f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ebf407-48da-4967-829d-77749df78f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a45c95-a386-4841-94d5-b6539bf1f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a45c95-a386-4841-94d5-b6539bf1f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80322ed4-f16d-405d-a74f-3551d00c41b7', 'volume_name': 'volume-80322ed4-f16d-405d-a74f-3551d00c41b7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989889d1-3994-412e-8586-3b83a4ea0f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989889d1-3994-412e-8586-3b83a4ea0f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37a6cea-f14d-4d1f-aad4-298dd8e8c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:13 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Volume 80322ed4-f16d-405d-a74f-3551d00c41b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80322ed4-f16d-405d-a74f-3551d00c41b7', 'volume_size': 1} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1238912698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80322ed4-f16d-405d-a74f-3551d00c41b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac4ce5bd6044d42ac1aca411487278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:14Z,use_quota=True,user_id='37a980d9c8804a828dbb8729ab796b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Creating volume 80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:13 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:13 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 1073741824 Apr 17 16:00:13 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:14 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 1073741824" returned: 0 in 0.567s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:14 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 Apr 17 16:00:14 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:14 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7" returned: 0 in 0.456s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37a6cea-f14d-4d1f-aad4-298dd8e8c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80322ed4-f16d-405d-a74f-3551d00c41b7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c54b86-9745-4aad-83eb-c86d4b6cd8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:14 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Volume volume-80322ed4-f16d-405d-a74f-3551d00c41b7 (80322ed4-f16d-405d-a74f-3551d00c41b7): created successfully Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c54b86-9745-4aad-83eb-c86d4b6cd8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (5e9d5fe8-b252-4f89-9288-76738b74312d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1d63d4f6-03a4-422e-ba3f-dc148cf4dd0a tempest-VolumeDependencyTests-1749426838 None] Created volume successfully. Apr 17 16:00:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Creating offline snapshot 79279ab7-7732-4e32-aa6b-c2b873e17f7c of volume 80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:00:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf30206a-cb8b-418a-bebe-c8a0fdd14333]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:16 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 Apr 17 16:00:16 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:16 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7" returned: 0 in 0.528s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:16 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c 1G Apr 17 16:00:16 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:17 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c 1G" returned: 0 in 0.589s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80322ed4-f16d-405d-a74f-3551d00c41b7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:17 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80322ed4-f16d-405d-a74f-3551d00c41b7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c Apr 17 16:00:17 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:17 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80322ed4-f16d-405d-a74f-3551d00c41b7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c" returned: 0 in 0.461s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:17 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c is being set with open permissions: ugo+rw Apr 17 16:00:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:17 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c Apr 17 16:00:17 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:18 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c" returned: 0 in 0.421s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:18 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.info Apr 17 16:00:18 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:18 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.info" returned: 0 in 0.426s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:18 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.info is being set with open permissions: ugo+rw Apr 17 16:00:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:18 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.info Apr 17 16:00:18 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:18 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.info" returned: 0 in 0.425s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0d47a9ca-0601-40c1-afb6-ecf4f6384b3c tempest-VolumeDependencyTests-1749426838 None] Create snapshot completed successfully Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Flow 'volume_create_manager' (e19e894c-7ccb-4680-b155-22a667c121a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc41ce1c-6b94-4e5b-a74b-22d9cc5441fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc41ce1c-6b94-4e5b-a74b-22d9cc5441fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-847014771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecebb051-dbd0-4b72-bb66-0b6e4466f1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae6c35a476a4d95ab4f3a84c92e989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:19Z,use_quota=True,user_id='377f95ca888140d49d6c440038f5cbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6849e211-413c-4496-88e8-fb0c439ff304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6849e211-413c-4496-88e8-fb0c439ff304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24867d16-11d0-42c6-a899-e03ef7ebb81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24867d16-11d0-42c6-a899-e03ef7ebb81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecebb051-dbd0-4b72-bb66-0b6e4466f1cc', 'volume_name': 'volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c292f5ae-d025-4a18-b488-c20640473718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c292f5ae-d025-4a18-b488-c20640473718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3faff58-afff-4885-92b9-62d314571a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Volume ecebb051-dbd0-4b72-bb66-0b6e4466f1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc', 'volume_size': 1} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-847014771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecebb051-dbd0-4b72-bb66-0b6e4466f1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae6c35a476a4d95ab4f3a84c92e989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:19Z,use_quota=True,user_id='377f95ca888140d49d6c440038f5cbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Creating volume ecebb051-dbd0-4b72-bb66-0b6e4466f1cc {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:19 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:19 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc 1073741824 Apr 17 16:00:19 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (685ba4ec-2034-4a0e-ba3c-42392ad0e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e94606-c075-433a-bf45-8b035b4a083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e94606-c075-433a-bf45-8b035b4a083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2099477342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce84eeb8-65bc-4e46-9f99-094c59d91c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac4ce5bd6044d42ac1aca411487278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79279ab7-7732-4e32-aa6b-c2b873e17f7c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:19Z,use_quota=True,user_id='37a980d9c8804a828dbb8729ab796b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ca04ad-882c-440a-b7e0-686094e6edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ca04ad-882c-440a-b7e0-686094e6edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6252a4-6d72-4e17-8e25-418e4b0540aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6252a4-6d72-4e17-8e25-418e4b0540aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce84eeb8-65bc-4e46-9f99-094c59d91c4a', 'volume_name': 'volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a', 'volume_size': 1, 'snapshot_id': '79279ab7-7732-4e32-aa6b-c2b873e17f7c'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee8643e-370e-4cf1-b16c-fba9f9d270bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee8643e-370e-4cf1-b16c-fba9f9d270bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174e7b88-322a-4d44-a543-2178f83a6856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:19 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Volume ce84eeb8-65bc-4e46-9f99-094c59d91c4a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a', 'volume_size': 1, 'snapshot_id': '79279ab7-7732-4e32-aa6b-c2b873e17f7c'} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:19 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc 1073741824" returned: 0 in 0.512s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:19 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc Apr 17 16:00:19 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:20 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc" returned: 0 in 0.404s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.587s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-79279ab7-7732-4e32-aa6b-c2b873e17f7c-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3faff58-afff-4885-92b9-62d314571a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b20ee39-568f-4bb5-91d5-c58038da9f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-79279ab7-7732-4e32-aa6b-c2b873e17f7c-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Creating volume ce84eeb8-65bc-4e46-9f99-094c59d91c4a from snapshot 79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:20 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Volume volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc (ecebb051-dbd0-4b72-bb66-0b6e4466f1cc): created successfully Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b20ee39-568f-4bb5-91d5-c58038da9f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Flow 'volume_create_manager' (e19e894c-7ccb-4680-b155-22a667c121a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:20 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e83aafe3-7087-4870-bcaa-28671645f133 tempest-VolumesListAdminTestJSON-1196446642 None] Created volume successfully. Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] snapshot: 79279ab7-7732-4e32-aa6b-c2b873e17f7c, volume: ce84eeb8-65bc-4e46-9f99-094c59d91c4a, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3ec12-68f3-464b-ab0e-f21533f87ffc]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:20 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c Apr 17 16:00:20 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:20 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80322ed4-f16d-405d-a74f-3551d00c41b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a33df-31a5-4d91-9f39-0c96dbd5e23d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:20 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 Apr 17 16:00:20 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:21 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7" returned: 0 in 0.448s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:21 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a Apr 17 16:00:21 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Flow 'volume_create_manager' (0d9f1482-6178-4bbd-b3f4-5a477cd58d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01d1646-9974-4fbc-9666-c5315597d0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01d1646-9974-4fbc-9666-c5315597d0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1814649029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2512b751-525d-4e83-8c0b-6daaea34be47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae6c35a476a4d95ab4f3a84c92e989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:21Z,use_quota=True,user_id='377f95ca888140d49d6c440038f5cbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcab1169-1b4a-42da-adfb-274a1d6af890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcab1169-1b4a-42da-adfb-274a1d6af890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37f0b02-1ffb-4cf4-ab63-e877e40aaa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37f0b02-1ffb-4cf4-ab63-e877e40aaa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2512b751-525d-4e83-8c0b-6daaea34be47', 'volume_name': 'volume-2512b751-525d-4e83-8c0b-6daaea34be47', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509a29df-4687-448e-961b-e9c45e83a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509a29df-4687-448e-961b-e9c45e83a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2064ae92-b84d-492f-92a6-36c0eab69ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:21 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Volume 2512b751-525d-4e83-8c0b-6daaea34be47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2512b751-525d-4e83-8c0b-6daaea34be47', 'volume_size': 1} Apr 17 16:00:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:23 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" returned: 0 in 1.917s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:23 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[720a281d-fe61-4f74-a410-96919fc8f9d4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:23 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 Apr 17 16:00:23 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:23 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7" returned: 0 in 0.582s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:23 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:00:23 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Converted 1024.00 MB image at 533.71 MB/s Apr 17 16:00:23 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a is being set with open permissions: ugo+rw Apr 17 16:00:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:23 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a Apr 17 16:00:23 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:23 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" returned: 0 in 0.400s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" released by "_copy_volume_from_snapshot" :: held 3.860s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-79279ab7-7732-4e32-aa6b-c2b873e17f7c-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" released by "_create_volume_from_snapshot" :: held 3.891s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.915s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.483s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1814649029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2512b751-525d-4e83-8c0b-6daaea34be47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae6c35a476a4d95ab4f3a84c92e989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:21Z,use_quota=True,user_id='377f95ca888140d49d6c440038f5cbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Creating volume 2512b751-525d-4e83-8c0b-6daaea34be47 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:24 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:24 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 1073741824 Apr 17 16:00:24 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174e7b88-322a-4d44-a543-2178f83a6856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a', 'volume_size': 1, 'snapshot_id': '79279ab7-7732-4e32-aa6b-c2b873e17f7c'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f40f0bc-004b-454a-86ad-bf92b1e95b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:24 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Volume volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a (ce84eeb8-65bc-4e46-9f99-094c59d91c4a): created successfully Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f40f0bc-004b-454a-86ad-bf92b1e95b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (685ba4ec-2034-4a0e-ba3c-42392ad0e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-88bd76b5-5c2c-4c46-9e14-64f4fad612bf tempest-VolumeDependencyTests-1749426838 None] Created volume successfully. Apr 17 16:00:24 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 1073741824" returned: 0 in 0.458s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:24 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 Apr 17 16:00:24 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-79279ab7-7732-4e32-aa6b-c2b873e17f7c-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-79279ab7-7732-4e32-aa6b-c2b873e17f7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-80322ed4-f16d-405d-a74f-3551d00c41b7" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-80322ed4-f16d-405d-a74f-3551d00c41b7" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-79279ab7-7732-4e32-aa6b-c2b873e17f7c" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-79279ab7-7732-4e32-aa6b-c2b873e17f7c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Deleting offline snapshot 79279ab7-7732-4e32-aa6b-c2b873e17f7c of volume 80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] snapshot_file for this snap is: volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc2269d-05ff-4a64-aae4-975768b9ec1a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:24 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47" returned: 0 in 0.422s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2064ae92-b84d-492f-92a6-36c0eab69ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2512b751-525d-4e83-8c0b-6daaea34be47', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa77d4e1-aaa9-4d81-8468-33d8de638544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:24 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Volume volume-2512b751-525d-4e83-8c0b-6daaea34be47 (2512b751-525d-4e83-8c0b-6daaea34be47): created successfully Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa77d4e1-aaa9-4d81-8468-33d8de638544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:24 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Flow 'volume_create_manager' (0d9f1482-6178-4bbd-b3f4-5a477cd58d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:24 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c Apr 17 16:00:24 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0d199431-bf2f-45da-86b1-f48a1fe62917 tempest-VolumesListAdminTestJSON-1196446642 None] Created volume successfully. Apr 17 16:00:25 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c" returned: 0 in 0.456s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80322ed4-f16d-405d-a74f-3551d00c41b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3e85a5-64c5-4bc8-b558-978e8022f59e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:25 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 Apr 17 16:00:25 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:25 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:25 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c Apr 17 16:00:25 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:25 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Flow 'volume_create_manager' (ee9f1a35-2a9a-4045-a6bd-ee3d8a6d37a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b332a926-0c24-418a-9666-f847b704d172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b332a926-0c24-418a-9666-f847b704d172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1106099870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94a856c-61d5-4734-a133-46748a1a8450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae6c35a476a4d95ab4f3a84c92e989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:26Z,use_quota=True,user_id='377f95ca888140d49d6c440038f5cbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a7093d-57b0-42ff-9f24-88dc5dfdf576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a7093d-57b0-42ff-9f24-88dc5dfdf576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77498d6-525d-40d0-846b-86d418c694c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77498d6-525d-40d0-846b-86d418c694c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94a856c-61d5-4734-a133-46748a1a8450', 'volume_name': 'volume-d94a856c-61d5-4734-a133-46748a1a8450', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36bb8c7-f2e8-4886-82d7-14bb3f6b3cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36bb8c7-f2e8-4886-82d7-14bb3f6b3cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f147432-2c34-4d0e-9e56-583632646648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:26 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Volume d94a856c-61d5-4734-a133-46748a1a8450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94a856c-61d5-4734-a133-46748a1a8450', 'volume_size': 1} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1106099870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94a856c-61d5-4734-a133-46748a1a8450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae6c35a476a4d95ab4f3a84c92e989b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:26Z,use_quota=True,user_id='377f95ca888140d49d6c440038f5cbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Creating volume d94a856c-61d5-4734-a133-46748a1a8450 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:26 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:26 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 1073741824 Apr 17 16:00:26 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:26 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:26 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c Apr 17 16:00:26 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:26 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 1073741824" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:26 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 Apr 17 16:00:26 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:26 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7.79279ab7-7732-4e32-aa6b-c2b873e17f7c" returned: 0 in 0.426s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-79279ab7-7732-4e32-aa6b-c2b873e17f7c" released by "_delete_snapshot" :: held 1.887s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-80322ed4-f16d-405d-a74f-3551d00c41b7" released by "delete_snapshot" :: held 1.899s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Created reservations ['3195f93b-5833-43c3-ba06-29f837c4984b', '4d41bdd0-4722-4bfb-8fe0-e0067e39d3d4', '6277076b-0d98-4a0f-8ab0-0d1f4469c3a0', 'e92a5628-4119-4a76-805c-ff3e1ef6c2a3'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:26 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Delete snapshot completed successfully. Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f2d4aa40-7ae6-4804-9cfd-6bdcea8016e8 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-79279ab7-7732-4e32-aa6b-c2b873e17f7c-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:26 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450" returned: 0 in 0.431s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-80322ed4-f16d-405d-a74f-3551d00c41b7-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f147432-2c34-4d0e-9e56-583632646648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94a856c-61d5-4734-a133-46748a1a8450', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53745880-c0ac-488e-af2a-6628128fb27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:27 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Volume volume-d94a856c-61d5-4734-a133-46748a1a8450 (d94a856c-61d5-4734-a133-46748a1a8450): created successfully Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53745880-c0ac-488e-af2a-6628128fb27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Flow 'volume_create_manager' (ee9f1a35-2a9a-4045-a6bd-ee3d8a6d37a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-80322ed4-f16d-405d-a74f-3551d00c41b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:27 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-42436ab2-e2c1-464e-9c3c-4599568760f1 tempest-VolumesListAdminTestJSON-1196446642 None] Created volume successfully. Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-80322ed4-f16d-405d-a74f-3551d00c41b7" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-80322ed4-f16d-405d-a74f-3551d00c41b7" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1418b9-ca23-4d84-affd-331c17b50800]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:27 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 Apr 17 16:00:27 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:27 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:27 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7 Apr 17 16:00:27 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:27 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-80322ed4-f16d-405d-a74f-3551d00c41b7" returned: 0 in 0.416s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-80322ed4-f16d-405d-a74f-3551d00c41b7" released by "delete_volume" :: held 0.893s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:27 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Created reservations ['97ac1a54-fda9-4529-a36f-61a0579395e5', '120d9ef6-e301-4aa7-a2d0-a00f76f03dd1', 'bd78e099-90aa-457e-8800-1d0674a6e362', 'a63ec47a-2806-4af4-bd10-42a54ce42693'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:28 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:28 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (872b5ed0-3090-48ec-9576-48abbfcfa2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4290ad-218a-49e3-875f-31d1454ef062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4290ad-218a-49e3-875f-31d1454ef062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248333382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed1c9dd-d10b-44f3-b1a7-76064daebe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac4ce5bd6044d42ac1aca411487278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:28Z,use_quota=True,user_id='37a980d9c8804a828dbb8729ab796b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eda83b-4696-4564-b0c0-4810c0abcf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eda83b-4696-4564-b0c0-4810c0abcf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e37b01f-f0b6-4583-b323-63b746bb94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e37b01f-f0b6-4583-b323-63b746bb94a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed1c9dd-d10b-44f3-b1a7-76064daebe8b', 'volume_name': 'volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dcd7fc-acbc-4b94-befc-d7f300e72478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dcd7fc-acbc-4b94-befc-d7f300e72478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a2b55e-ef65-4f41-9b6f-82d427601591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Volume 5ed1c9dd-d10b-44f3-b1a7-76064daebe8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b', 'volume_size': 1} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248333382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed1c9dd-d10b-44f3-b1a7-76064daebe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac4ce5bd6044d42ac1aca411487278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:28Z,use_quota=True,user_id='37a980d9c8804a828dbb8729ab796b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Creating volume 5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:28 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:28 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b 1073741824 Apr 17 16:00:28 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Flow 'volume_create_manager' (b4755608-65b3-4efe-a7f2-2e94d0558d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eefd628-dd76-45fa-8daf-7ba7a83940cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eefd628-dd76-45fa-8daf-7ba7a83940cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ce970e-9769-4263-b513-ef0bb7012b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5112314970e24754beb7fd8eace814c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:28Z,use_quota=True,user_id='8f7b518aed2d4ea2a581a2bd35903727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479d25c9-615d-4a69-a851-794116f44e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479d25c9-615d-4a69-a851-794116f44e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6322d9e-c1b4-4eff-a7a8-357e8762ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6322d9e-c1b4-4eff-a7a8-357e8762ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ce970e-9769-4263-b513-ef0bb7012b68', 'volume_name': 'volume-e1ce970e-9769-4263-b513-ef0bb7012b68', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9342a3c3-afb6-4f9e-b048-5eb7421ec1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9342a3c3-afb6-4f9e-b048-5eb7421ec1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6a83a1-35d2-409d-b066-b323eeff9b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:28 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Volume e1ce970e-9769-4263-b513-ef0bb7012b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ce970e-9769-4263-b513-ef0bb7012b68', 'volume_size': 1} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.544s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:28 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Deleted volume successfully. Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-767d1cdf-f3a6-4777-9a1e-5a92f78dfa36 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-80322ed4-f16d-405d-a74f-3551d00c41b7-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:28 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b 1073741824" returned: 0 in 0.509s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:28 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b Apr 17 16:00:28 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:29 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" returned: 0 in 0.406s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ce970e-9769-4263-b513-ef0bb7012b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5112314970e24754beb7fd8eace814c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:28Z,use_quota=True,user_id='8f7b518aed2d4ea2a581a2bd35903727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Creating volume e1ce970e-9769-4263-b513-ef0bb7012b68 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:29 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a2b55e-ef65-4f41-9b6f-82d427601591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0c70d8-5216-4459-8b12-3bdbbe809f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:29 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 1073741824 Apr 17 16:00:29 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Volume volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b (5ed1c9dd-d10b-44f3-b1a7-76064daebe8b): created successfully Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0c70d8-5216-4459-8b12-3bdbbe809f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (872b5ed0-3090-48ec-9576-48abbfcfa2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-38a1672a-ca96-4717-a3ff-7e432ca65c73 tempest-VolumeDependencyTests-1749426838 None] Created volume successfully. Apr 17 16:00:29 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 1073741824" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:29 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 Apr 17 16:00:29 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:30 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68" returned: 0 in 0.397s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6a83a1-35d2-409d-b066-b323eeff9b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ce970e-9769-4263-b513-ef0bb7012b68', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2deb282-b6c1-4729-8a7b-6cc88acd43ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:30 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Volume volume-e1ce970e-9769-4263-b513-ef0bb7012b68 (e1ce970e-9769-4263-b513-ef0bb7012b68): created successfully Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2deb282-b6c1-4729-8a7b-6cc88acd43ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Flow 'volume_create_manager' (b4755608-65b3-4efe-a7f2-2e94d0558d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:30 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d4f2164c-0f88-45af-b5e7-7c8d467587da tempest-VolumesListAdminTestJSON-1693003008 None] Created volume successfully. Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (c88069f6-9480-4eed-ab17-0c4ac9cdc632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4380dd44-2fa9-4a72-9fc1-f0c8889a5320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4380dd44-2fa9-4a72-9fc1-f0c8889a5320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-73017687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3a6f07-db0b-4589-9579-d342cd7b3d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac4ce5bd6044d42ac1aca411487278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5ed1c9dd-d10b-44f3-b1a7-76064daebe8b,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:31Z,use_quota=True,user_id='37a980d9c8804a828dbb8729ab796b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bef1d5-2aee-46ba-8668-a4067966ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bef1d5-2aee-46ba-8668-a4067966ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0b874c-d3a2-45b4-867d-4d242bf0c4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Acquiring lock "cinder-e1ce970e-9769-4263-b513-ef0bb7012b68-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0b874c-d3a2-45b4-867d-4d242bf0c4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cf3a6f07-db0b-4589-9579-d342cd7b3d74', 'volume_name': 'volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74', 'volume_size': 1, 'source_volid': '5ed1c9dd-d10b-44f3-b1a7-76064daebe8b', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7a377c-58e8-42cc-bd2d-a7505e0354b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7a377c-58e8-42cc-bd2d-a7505e0354b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce825a2-97a3-48a4-95e9-146a0d395741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:30 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Volume cf3a6f07-db0b-4589-9579-d342cd7b3d74: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74', 'volume_size': 1, 'source_volid': '5ed1c9dd-d10b-44f3-b1a7-76064daebe8b', 'source_volstatus': 'available'} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:30 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Cloning volume 5ed1c9dd-d10b-44f3-b1a7-76064daebe8b to volume cf3a6f07-db0b-4589-9579-d342cd7b3d74 Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Lock "cinder-e1ce970e-9769-4263-b513-ef0bb7012b68-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "cinder-d94a856c-61d5-4734-a133-46748a1a8450-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Creating offline snapshot e895a46a-d052-4990-aaec-96212aec2723 of volume 5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-d94a856c-61d5-4734-a133-46748a1a8450-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b6802-dd92-4294-92b7-d2d70a6043f2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Acquiring lock "cinder-quobyte-e1ce970e-9769-4263-b513-ef0bb7012b68" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "cinder-quobyte-d94a856c-61d5-4734-a133-46748a1a8450" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Lock "cinder-quobyte-e1ce970e-9769-4263-b513-ef0bb7012b68" acquired by "delete_volume" :: waited 0.022s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[734769a5-a98c-4a49-9430-e6998f99a8d0]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-quobyte-d94a856c-61d5-4734-a133-46748a1a8450" acquired by "delete_volume" :: waited 0.025s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e48ab3c-c111-42fb-8145-8cb174674396]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:30 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b Apr 17 16:00:30 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:30 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 Apr 17 16:00:30 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:30 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 Apr 17 16:00:30 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:31 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" returned: 0 in 0.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:31 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 1G Apr 17 16:00:31 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:31 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68" returned: 0 in 0.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:31 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:31 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68 Apr 17 16:00:31 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:31 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450 Apr 17 16:00:31 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:31 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e1ce970e-9769-4263-b513-ef0bb7012b68" returned: 0 in 0.439s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Lock "cinder-quobyte-e1ce970e-9769-4263-b513-ef0bb7012b68" released by "delete_volume" :: held 0.943s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:31 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-d94a856c-61d5-4734-a133-46748a1a8450" returned: 0 in 0.449s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-quobyte-d94a856c-61d5-4734-a133-46748a1a8450" released by "delete_volume" :: held 0.951s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Created reservations ['bdceb068-c5d2-47db-8615-4f2cd0e57c4b', 'a457b881-31f8-4774-ac1d-cf5b2a26873b', '86263841-6de5-4e12-b763-f612e8f1c793', 'b24abecb-1abf-4396-84e2-609f3f733453'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:31 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 1G" returned: 0 in 0.545s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:31 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 Apr 17 16:00:31 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Created reservations ['ce56deef-7c23-4ebf-a283-5b7c16060a5c', '5aa72e55-33b6-4657-b179-6d652044c894', '232ccec9-a1b8-48a5-92b5-b4616d76a6d6', '8e3d3c87-b1f8-4e09-85f4-bfaa4c027de5'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:31 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:31 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:32 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:32 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:32 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723" returned: 0 in 0.434s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:32 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 is being set with open permissions: ugo+rw Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:32 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 Apr 17 16:00:32 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:32 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.452s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:32 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Deleted volume successfully. Apr 17 16:00:32 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.442s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-467f7698-bc2e-4943-b504-8a01434e32b5 tempest-VolumesListAdminTestJSON-1693003008 None] Lock "cinder-e1ce970e-9769-4263-b513-ef0bb7012b68-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:32 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Deleted volume successfully. Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-df96a6d0-9bec-4768-9f75-53058300395c tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-d94a856c-61d5-4734-a133-46748a1a8450-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:32 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723" returned: 0 in 0.430s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:32 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.info Apr 17 16:00:32 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "cinder-2512b751-525d-4e83-8c0b-6daaea34be47-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-2512b751-525d-4e83-8c0b-6daaea34be47-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "cinder-quobyte-2512b751-525d-4e83-8c0b-6daaea34be47" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-quobyte-2512b751-525d-4e83-8c0b-6daaea34be47" acquired by "delete_volume" :: waited 0.021s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c02b0b-4599-428a-93ea-5018e12041ac]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:33 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 Apr 17 16:00:33 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:33 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.info" returned: 0 in 0.411s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:33 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.info is being set with open permissions: ugo+rw Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:33 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.info Apr 17 16:00:33 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:33 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47" returned: 0 in 0.469s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:33 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47 Apr 17 16:00:33 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:33 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.info" returned: 0 in 0.427s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-cf3a6f07-db0b-4589-9579-d342cd7b3d74" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-cf3a6f07-db0b-4589-9579-d342cd7b3d74" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] snapshot: e895a46a-d052-4990-aaec-96212aec2723, volume: cf3a6f07-db0b-4589-9579-d342cd7b3d74, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fedb38-b741-4be2-890a-696bac21d588]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:33 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 Apr 17 16:00:33 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:33 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-2512b751-525d-4e83-8c0b-6daaea34be47" returned: 0 in 0.407s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-quobyte-2512b751-525d-4e83-8c0b-6daaea34be47" released by "delete_volume" :: held 0.904s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Created reservations ['5b9be5ef-b352-4a60-ba21-675c58c77100', 'd61ce3e7-d525-4906-b1ba-d61725185786', '7b832678-65e1-4364-8e1a-9788e6bccfd0', '491e3824-329e-44ed-ac75-1e8b54028046'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:34 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:34 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:34 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef8654-a239-4509-95bf-3d4f3f39236b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "cinder-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:34 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b Apr 17 16:00:34 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "cinder-quobyte-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-quobyte-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ab22f5-97b8-404f-93eb-f142aa824ce5]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:34 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc Apr 17 16:00:34 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:34 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:34 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:34 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.426s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Deleted volume successfully. Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9070bae5-43bd-4601-b81f-3c6fe0df5487 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-2512b751-525d-4e83-8c0b-6daaea34be47-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:34 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" returned: 0 in 0.530s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:34 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 Apr 17 16:00:34 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:34 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc" returned: 0 in 0.525s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:34 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.429s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:34 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc Apr 17 16:00:34 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:35 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc" returned: 0 in 0.575s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-quobyte-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc" released by "delete_volume" :: held 1.137s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Created reservations ['633ec61a-ad60-4630-90e2-845ed8e75742', '8f0d6f8e-fdf2-4028-989c-365877446bd3', '2b494452-3750-497d-ad97-e6bc736d6da3', '00335e37-23af-4a0e-b4a6-79154e37485a'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:35 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:35 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:36 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74" returned: 0 in 1.966s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:36 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d144ff-3eac-442a-89f0-8c6689d9e010]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:36 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.129s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:36 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Deleted volume successfully. Apr 17 16:00:36 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b Apr 17 16:00:36 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-1bda40b2-da88-4d5a-8085-6ede819a7406 tempest-VolumesListAdminTestJSON-1196446642 None] Lock "cinder-ecebb051-dbd0-4b72-bb66-0b6e4466f1cc-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:37 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" returned: 0 in 0.685s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:00:37 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Converted 1024.00 MB image at 520.58 MB/s Apr 17 16:00:37 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 is being set with open permissions: ugo+rw Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:37 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 Apr 17 16:00:37 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:37 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74" returned: 0 in 0.443s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-cf3a6f07-db0b-4589-9579-d342cd7b3d74" released by "_copy_volume_from_snapshot" :: held 4.169s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-e895a46a-d052-4990-aaec-96212aec2723" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-e895a46a-d052-4990-aaec-96212aec2723" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Deleting offline snapshot e895a46a-d052-4990-aaec-96212aec2723 of volume 5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] snapshot_file for this snap is: volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5f0022-233d-4eb3-8803-98d26099928e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:37 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 Apr 17 16:00:37 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:38 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723" returned: 0 in 0.499s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:00:38 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5174f19f-7e39-4852-a60a-34d7fd524496]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:38 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b Apr 17 16:00:38 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:38 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" returned: 0 in 0.519s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:38 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 Apr 17 16:00:38 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:39 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723" returned: 0 in 0.558s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:39 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723 Apr 17 16:00:39 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:39 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b.e895a46a-d052-4990-aaec-96212aec2723" returned: 0 in 0.488s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-e895a46a-d052-4990-aaec-96212aec2723" released by "_delete_snapshot" :: held 2.120s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.164s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce825a2-97a3-48a4-95e9-146a0d395741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74', 'volume_size': 1, 'source_volid': '5ed1c9dd-d10b-44f3-b1a7-76064daebe8b', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b89cb8-6d62-4a92-b12a-70e62fb5c74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:39 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Volume volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 (cf3a6f07-db0b-4589-9579-d342cd7b3d74): created successfully Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b89cb8-6d62-4a92-b12a-70e62fb5c74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:39 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Flow 'volume_create_manager' (c88069f6-9480-4eed-ab17-0c4ac9cdc632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:39 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b7a35803-4ba8-48dd-88ef-f7920c4e5711 tempest-VolumeDependencyTests-1749426838 None] Created volume successfully. Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c17c7-a553-40d8-9ba7-acf290fdb1b0]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:40 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b Apr 17 16:00:40 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:40 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:40 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b Apr 17 16:00:40 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:41 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" returned: 0 in 0.477s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b" released by "delete_volume" :: held 1.029s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Created reservations ['ee640978-145d-4af9-8e31-80f9294d4405', 'b07f0703-dfcd-45d4-bb21-60e32ea44264', 'e116d6c3-4a89-45da-9c2a-7e31b9fc780e', '0217355e-bcc1-4c25-984d-d68e39280f0e'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:41 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:41 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Flow 'volume_create_manager' (6e1abc90-61ec-4c48-ad5e-bd533180ee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d960c314-77cb-4dc6-b593-8826331740d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d960c314-77cb-4dc6-b593-8826331740d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1199611496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb6e57a-3406-4ee6-a64f-6ae4387daf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1146ac43be154eea8c5b93ebb9c7b0ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:42Z,use_quota=True,user_id='582ca4b2d5584295b47a3277b0613cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5902194d-3513-47e1-b0c6-46e35d51a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5902194d-3513-47e1-b0c6-46e35d51a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b4238e-fce7-4fd4-9d8d-46e9af9b79ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b4238e-fce7-4fd4-9d8d-46e9af9b79ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb6e57a-3406-4ee6-a64f-6ae4387daf9c', 'volume_name': 'volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:41 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3e7bda-d647-47f2-86b4-12890f299e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3e7bda-d647-47f2-86b4-12890f299e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180b8a14-0a03-4be8-aedf-caa48d461de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:41 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Volume 3eb6e57a-3406-4ee6-a64f-6ae4387daf9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c', 'volume_size': 1} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1199611496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb6e57a-3406-4ee6-a64f-6ae4387daf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1146ac43be154eea8c5b93ebb9c7b0ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:42Z,use_quota=True,user_id='582ca4b2d5584295b47a3277b0613cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Creating volume 3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:41 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Deleted volume successfully. Apr 17 16:00:41 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c 1073741824 Apr 17 16:00:41 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b46dc068-21b8-4ae2-871b-b60c385aab50 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-5ed1c9dd-d10b-44f3-b1a7-76064daebe8b-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:42 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c 1073741824" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:42 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c Apr 17 16:00:42 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-cf3a6f07-db0b-4589-9579-d342cd7b3d74-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-cf3a6f07-db0b-4589-9579-d342cd7b3d74-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-cf3a6f07-db0b-4589-9579-d342cd7b3d74" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-cf3a6f07-db0b-4589-9579-d342cd7b3d74" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb0e564-8eaf-4b4c-a3bc-fc2c44b28d5a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:42 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 Apr 17 16:00:42 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:42 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" returned: 0 in 0.428s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180b8a14-0a03-4be8-aedf-caa48d461de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235b455c-d8c8-47b0-83da-be43145f8962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:42 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Volume volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c (3eb6e57a-3406-4ee6-a64f-6ae4387daf9c): created successfully Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235b455c-d8c8-47b0-83da-be43145f8962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:42 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Flow 'volume_create_manager' (6e1abc90-61ec-4c48-ad5e-bd533180ee36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:42 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ebe1641f-07fd-427e-bc9e-9ae79fff214a tempest-SnapshotMetadataTestJSON-2107769774 None] Created volume successfully. Apr 17 16:00:42 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74" returned: 0 in 0.481s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:43 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74 Apr 17 16:00:43 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:43 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-cf3a6f07-db0b-4589-9579-d342cd7b3d74" returned: 0 in 0.397s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-cf3a6f07-db0b-4589-9579-d342cd7b3d74" released by "delete_volume" :: held 0.901s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Created reservations ['5677c66a-4073-455d-8f64-24f002d45a92', 'c51abaa4-c39b-4454-b7c2-5841ed4f5029', 'cc14c118-3051-47e4-97aa-bb3e626f075e', '769e2689-1da8-4b13-9428-9edd9c775aef'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:43 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:43 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-ce84eeb8-65bc-4e46-9f99-094c59d91c4a-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-ce84eeb8-65bc-4e46-9f99-094c59d91c4a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "cinder-quobyte-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368d49a-0fae-46f7-975a-db58ca4b8182]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:43 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a Apr 17 16:00:43 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:43 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.469s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Deleted volume successfully. Apr 17 16:00:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-0bf3ada9-a3a0-4ba6-971f-45bf6d5279df tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-cf3a6f07-db0b-4589-9579-d342cd7b3d74-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Creating offline snapshot 35b3038d-78ac-453f-a425-efdbc4fc8b91 of volume 3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7b163-2160-4963-a9ee-6251d0428ee5]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:44 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c Apr 17 16:00:44 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:44 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" returned: 0 in 0.523s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:44 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a Apr 17 16:00:44 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:44 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" returned: 0 in 0.462s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:44 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 1G Apr 17 16:00:44 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:44 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" returned: 0 in 0.413s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-quobyte-ce84eeb8-65bc-4e46-9f99-094c59d91c4a" released by "delete_volume" :: held 0.959s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Created reservations ['fe0edc0f-eafe-4ac6-8550-a3218b1e12ef', 'd7358929-0023-423b-aeaf-3f9f6ce62baf', '79d1b30d-1ea5-4a49-8c0d-8b86411de3f8', '26052098-1959-4de4-ba86-7f55d54009d5'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:44 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:44 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:45 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 1G" returned: 0 in 0.569s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:45 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 Apr 17 16:00:45 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:45 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.479s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:45 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Deleted volume successfully. Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-63ae9bc6-3607-40c3-9159-9abea3b13cd1 tempest-VolumeDependencyTests-1749426838 None] Lock "cinder-ce84eeb8-65bc-4e46-9f99-094c59d91c4a-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:45 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:45 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 is being set with open permissions: ugo+rw Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:45 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 Apr 17 16:00:45 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:45 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91" returned: 0 in 0.418s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:46 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.info Apr 17 16:00:46 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:46 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.info" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:46 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.info is being set with open permissions: ugo+rw Apr 17 16:00:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:46 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.info Apr 17 16:00:46 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:46 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.info" returned: 0 in 0.478s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.904s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-912d4006-9bd2-4692-88a5-fa8d7f86f8a1 tempest-SnapshotMetadataTestJSON-2107769774 None] Create snapshot completed successfully Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "cinder-35b3038d-78ac-453f-a425-efdbc4fc8b91-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-35b3038d-78ac-453f-a425-efdbc4fc8b91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "cinder-quobyte-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-quobyte-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "cinder-quobyte-35b3038d-78ac-453f-a425-efdbc4fc8b91" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-quobyte-35b3038d-78ac-453f-a425-efdbc4fc8b91" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Deleting offline snapshot 35b3038d-78ac-453f-a425-efdbc4fc8b91 of volume 3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] snapshot_file for this snap is: volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5872d4-b48b-4c0a-919b-5f06f8dc8d45]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:47 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 Apr 17 16:00:47 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:48 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91" returned: 0 in 0.520s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:00:48 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[32752ded-07ed-4a85-969d-02aa487825d6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:48 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c Apr 17 16:00:48 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:48 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" returned: 0 in 0.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:48 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 Apr 17 16:00:48 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:49 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91" returned: 0 in 0.510s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:49 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91 Apr 17 16:00:49 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:49 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c.35b3038d-78ac-453f-a425-efdbc4fc8b91" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-quobyte-35b3038d-78ac-453f-a425-efdbc4fc8b91" released by "_delete_snapshot" :: held 2.055s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-quobyte-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" released by "delete_snapshot" :: held 2.070s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:49 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Created reservations ['51b19783-01b9-40b2-b9fe-faa4009b729a', '842ee4ca-3a96-4732-b7a7-12687db1762b', '1c519fdd-799f-4c2f-80af-9a9cfc855625', '9eb316d6-0662-40ef-8aec-84be53421151'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Delete snapshot completed successfully. Apr 17 16:00:49 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-41a3d0f6-f781-4491-9aef-e9bd525c8af9 tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-35b3038d-78ac-453f-a425-efdbc4fc8b91-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "cinder-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "cinder-quobyte-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:50 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-quobyte-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:50 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0df6e-e043-417c-a87c-a3bdb688f0b3]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:51 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c Apr 17 16:00:51 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:51 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:51 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c Apr 17 16:00:51 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:51 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" returned: 0 in 0.430s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:51 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-quobyte-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c" released by "delete_volume" :: held 0.998s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Created reservations ['d53c84b5-b8a1-45f0-9b2f-3691038902b0', 'a73b406e-3147-41b5-b57f-e812a264d3a8', '604e3122-8fea-456a-9113-9aaa4c240284', 'eb0c574b-cc7c-416b-887c-cd64354dd079'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:52 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:52 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:52 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.460s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:52 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Deleted volume successfully. Apr 17 16:00:52 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-f01b901a-c6c9-45cb-b3ca-019fffd526af tempest-SnapshotMetadataTestJSON-2107769774 None] Lock "cinder-3eb6e57a-3406-4ee6-a64f-6ae4387daf9c-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:54 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:00:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Flow 'volume_create_manager' (5b519254-41c1-493c-a768-337a48549263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:54 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b12157-e6d1-4f27-8fb4-06e1888107c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b12157-e6d1-4f27-8fb4-06e1888107c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1972148196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2c19e7-a86b-4cc5-b85e-7edacada4e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1fa14cb3b34c96a2c009ffc061140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:55Z,use_quota=True,user_id='ab2acb98d3244640b9f3b6db13f07cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f694c-5cd5-41dd-8beb-5def784be545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f694c-5cd5-41dd-8beb-5def784be545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932ca479-18e1-4b77-b233-a23ed0406b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932ca479-18e1-4b77-b233-a23ed0406b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2c19e7-a86b-4cc5-b85e-7edacada4e0a', 'volume_name': 'volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a', 'volume_size': 2}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1ee3fe-9758-4fac-818b-b1b755f75fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1ee3fe-9758-4fac-818b-b1b755f75fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2213cae2-5fed-4bb1-8f61-d60b62eff16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:55 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Volume 0d2c19e7-a86b-4cc5-b85e-7edacada4e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a', 'volume_size': 2} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1972148196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2c19e7-a86b-4cc5-b85e-7edacada4e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1fa14cb3b34c96a2c009ffc061140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:00:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:00:55Z,use_quota=True,user_id='ab2acb98d3244640b9f3b6db13f07cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Creating volume 0d2c19e7-a86b-4cc5-b85e-7edacada4e0a {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:00:55 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a 2147483648 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:55 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a 2147483648 Apr 17 16:00:55 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:55 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a 2147483648" returned: 0 in 0.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:55 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a Apr 17 16:00:55 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:56 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a" returned: 0 in 0.526s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:00:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2213cae2-5fed-4bb1-8f61-d60b62eff16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a', 'volume_size': 2}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5e0229-04e6-41fe-98bd-c0478c4fbad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:00:56 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Volume volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a (0d2c19e7-a86b-4cc5-b85e-7edacada4e0a): created successfully Apr 17 16:00:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5e0229-04e6-41fe-98bd-c0478c4fbad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:00:56 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Flow 'volume_create_manager' (5b519254-41c1-493c-a768-337a48549263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:00:56 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d73faa5f-29eb-4bb0-8067-4b1ecafe06a4 tempest-VolumesCloneNegativeTest-72556250 None] Created volume successfully. Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Acquiring lock "cinder-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Lock "cinder-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Acquiring lock "cinder-quobyte-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Lock "cinder-quobyte-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[350a8f34-49ff-48fe-b8bc-14088dc32460]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:57 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a Apr 17 16:00:57 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:57 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a" returned: 0 in 0.505s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:57 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a Apr 17 16:00:57 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:58 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a" returned: 0 in 0.443s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Lock "cinder-quobyte-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a" released by "delete_volume" :: held 0.977s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Created reservations ['c2d79c3c-ef91-4e60-a376-1c33ae723774', '1f3f4892-216d-4bce-8ab2-28a832257cf0', '27c02efb-229d-402d-960c-cf38fef1f447', '25064c53-c8eb-4887-83cb-f8eb53050b87'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:00:58 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:00:58 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:00:58 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.599s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:00:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Deleted volume successfully. Apr 17 16:00:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aee070fe-4671-46b3-90fc-e25e74f0d141 tempest-VolumesCloneNegativeTest-72556250 None] Lock "cinder-0d2c19e7-a86b-4cc5-b85e-7edacada4e0a-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Flow 'volume_create_manager' (8cfacbfd-b204-4cfb-8bba-91f47e4eb2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd5bc1-7e7f-462b-946d-cac58a3edf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd5bc1-7e7f-462b-946d-cac58a3edf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-71288371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a746e34a08940e99d163ea31571bce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:00Z,use_quota=True,user_id='d85ecf5e31e24d84981d84bcd8af3e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dde968c-a7b4-4a6d-97b4-2091c88d948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dde968c-a7b4-4a6d-97b4-2091c88d948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6c67c2-0508-489e-ad1e-85b1eb6ec9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6c67c2-0508-489e-ad1e-85b1eb6ec9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef', 'volume_name': 'volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2459f06c-83e8-4d05-a14c-13c3557f0b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2459f06c-83e8-4d05-a14c-13c3557f0b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dbc235-4266-4b5f-8d67-96f32cdbdbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Volume a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef', 'volume_size': 1} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-71288371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a746e34a08940e99d163ea31571bce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:00Z,use_quota=True,user_id='d85ecf5e31e24d84981d84bcd8af3e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Creating volume a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:00 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:00 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef 1073741824 Apr 17 16:01:00 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:00 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef 1073741824" returned: 0 in 0.556s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:00 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef Apr 17 16:01:00 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Flow 'volume_create_manager' (a3837d4a-e00b-4baf-825b-b02a040f76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e51501-33b7-4109-80a9-08b75e1674db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e51501-33b7-4109-80a9-08b75e1674db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-10699807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23317039-e3a4-40f6-a527-a0587efd0d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b036fb0976674402a74a1590b31e5602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:01Z,use_quota=True,user_id='7e179bf5fba74455b8eae224931f3d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34747ea1-73e7-4943-a1d7-23900b61bba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34747ea1-73e7-4943-a1d7-23900b61bba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840d887d-f8f8-4736-8d92-e5ab92796fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840d887d-f8f8-4736-8d92-e5ab92796fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23317039-e3a4-40f6-a527-a0587efd0d04', 'volume_name': 'volume-23317039-e3a4-40f6-a527-a0587efd0d04', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371c72fb-e74d-4df2-952c-1a4dc91babe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371c72fb-e74d-4df2-952c-1a4dc91babe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869065f6-6729-4c94-9957-da96a1098dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Volume 23317039-e3a4-40f6-a527-a0587efd0d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23317039-e3a4-40f6-a527-a0587efd0d04', 'volume_size': 1} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:01 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef" returned: 0 in 0.430s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.213s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-10699807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23317039-e3a4-40f6-a527-a0587efd0d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b036fb0976674402a74a1590b31e5602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:01Z,use_quota=True,user_id='7e179bf5fba74455b8eae224931f3d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Creating volume 23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:01 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dbc235-4266-4b5f-8d67-96f32cdbdbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f493b849-b618-4e81-a730-980e3668b333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:01 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 1073741824 Apr 17 16:01:01 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Volume volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef (a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef): created successfully Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f493b849-b618-4e81-a730-980e3668b333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Flow 'volume_create_manager' (8cfacbfd-b204-4cfb-8bba-91f47e4eb2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:01 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-565412ea-0182-42f9-98cf-9ad6190ddbb1 tempest-VolumesNegativeTest-1714226190 None] Created volume successfully. Apr 17 16:01:01 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 1073741824" returned: 0 in 0.465s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:01 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 Apr 17 16:01:01 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:02 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04" returned: 0 in 0.401s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869065f6-6729-4c94-9957-da96a1098dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23317039-e3a4-40f6-a527-a0587efd0d04', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaeb660-c2fb-4eab-a3b7-1a3b358ad57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:02 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Volume volume-23317039-e3a4-40f6-a527-a0587efd0d04 (23317039-e3a4-40f6-a527-a0587efd0d04): created successfully Apr 17 16:01:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaeb660-c2fb-4eab-a3b7-1a3b358ad57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Flow 'volume_create_manager' (a3837d4a-e00b-4baf-825b-b02a040f76d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:02 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-31bba493-b6bf-44ba-96f9-76b627b34bf3 tempest-SnapshotDependencyTests-1672809384 None] Created volume successfully. Apr 17 16:01:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Creating offline snapshot 63ead167-ca90-4f34-9804-1e7df23473cd of volume 23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:01:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[47501d65-263b-43fe-9d25-da37e7c8339e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:03 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 Apr 17 16:01:03 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:03 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04" returned: 0 in 0.494s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:03 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd 1G Apr 17 16:01:03 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:04 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd 1G" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23317039-e3a4-40f6-a527-a0587efd0d04 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:04 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23317039-e3a4-40f6-a527-a0587efd0d04 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd Apr 17 16:01:04 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:04 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23317039-e3a4-40f6-a527-a0587efd0d04 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd" returned: 0 in 0.425s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:04 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd is being set with open permissions: ugo+rw Apr 17 16:01:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:04 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd Apr 17 16:01:04 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:05 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd" returned: 0 in 0.424s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:05 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.info Apr 17 16:01:05 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:05 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.info" returned: 0 in 0.409s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:05 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.info is being set with open permissions: ugo+rw Apr 17 16:01:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:05 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.info Apr 17 16:01:05 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:05 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.info" returned: 0 in 0.411s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:06 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-8789c210-a57c-4896-b600-abdc7e0e2fb0 tempest-SnapshotDependencyTests-1672809384 None] Create snapshot completed successfully Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Flow 'volume_create_manager' (f63caabc-e307-439f-a2f7-40463692aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9e2445-c251-4ed1-a55c-3ef80f162aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9e2445-c251-4ed1-a55c-3ef80f162aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12da390f-8d96-41a0-b5d2-e63ec90784a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b036fb0976674402a74a1590b31e5602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63ead167-ca90-4f34-9804-1e7df23473cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:07Z,use_quota=True,user_id='7e179bf5fba74455b8eae224931f3d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abf6de-3f1f-48a5-865a-15c91c5c1695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abf6de-3f1f-48a5-865a-15c91c5c1695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4f0632-4300-403b-ab76-ffc7d5931728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4f0632-4300-403b-ab76-ffc7d5931728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12da390f-8d96-41a0-b5d2-e63ec90784a4', 'volume_name': 'volume-12da390f-8d96-41a0-b5d2-e63ec90784a4', 'volume_size': 1, 'snapshot_id': '63ead167-ca90-4f34-9804-1e7df23473cd'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515ae564-e059-47b4-a238-5ff6fba60c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515ae564-e059-47b4-a238-5ff6fba60c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac2642-f500-4f90-9761-d3d6ae133c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:06 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Volume 12da390f-8d96-41a0-b5d2-e63ec90784a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12da390f-8d96-41a0-b5d2-e63ec90784a4', 'volume_size': 1, 'snapshot_id': '63ead167-ca90-4f34-9804-1e7df23473cd'} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-quobyte-63ead167-ca90-4f34-9804-1e7df23473cd-12da390f-8d96-41a0-b5d2-e63ec90784a4" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-63ead167-ca90-4f34-9804-1e7df23473cd-12da390f-8d96-41a0-b5d2-e63ec90784a4" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Creating volume 12da390f-8d96-41a0-b5d2-e63ec90784a4 from snapshot 63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-quobyte-12da390f-8d96-41a0-b5d2-e63ec90784a4" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-12da390f-8d96-41a0-b5d2-e63ec90784a4" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] snapshot: 63ead167-ca90-4f34-9804-1e7df23473cd, volume: 12da390f-8d96-41a0-b5d2-e63ec90784a4, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d1be4-2835-4960-ba2f-789d07670759]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:06 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd Apr 17 16:01:06 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:07 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd" returned: 0 in 0.496s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23317039-e3a4-40f6-a527-a0587efd0d04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b393c0-5b2b-44de-b254-132ef01d6608]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:07 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 Apr 17 16:01:07 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:07 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04" returned: 0 in 0.560s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:01:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:07 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 Apr 17 16:01:07 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:10 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4" returned: 0 in 2.111s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ae56cb-3758-408e-8a69-463924ffa9f9]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:10 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 Apr 17 16:01:10 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:10 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04" returned: 0 in 0.564s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:01:10 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Converted 1024.00 MB image at 484.84 MB/s Apr 17 16:01:10 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 is being set with open permissions: ugo+rw Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:10 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 Apr 17 16:01:10 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:10 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4" returned: 0 in 0.390s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-12da390f-8d96-41a0-b5d2-e63ec90784a4" released by "_copy_volume_from_snapshot" :: held 4.175s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-63ead167-ca90-4f34-9804-1e7df23473cd-12da390f-8d96-41a0-b5d2-e63ec90784a4" released by "_create_volume_from_snapshot" :: held 4.191s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.199s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:11 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=122,cinder:INSERT=40,cinder:UPDATE=163,cinder:DELETE=12 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:01:11 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=103,cinder:UPDATE=143,cinder:DELETE=15,cinder:INSERT=33 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:01:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac2642-f500-4f90-9761-d3d6ae133c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12da390f-8d96-41a0-b5d2-e63ec90784a4', 'volume_size': 1, 'snapshot_id': '63ead167-ca90-4f34-9804-1e7df23473cd'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b597e6-79e6-4e8b-bf4e-e15df0ddc3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:11 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Volume volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 (12da390f-8d96-41a0-b5d2-e63ec90784a4): created successfully Apr 17 16:01:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b597e6-79e6-4e8b-bf4e-e15df0ddc3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Flow 'volume_create_manager' (f63caabc-e307-439f-a2f7-40463692aed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:11 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2f0fbc8c-0bfe-463c-bf4e-daaea2e02b4b tempest-SnapshotDependencyTests-1672809384 None] Created volume successfully. Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-63ead167-ca90-4f34-9804-1e7df23473cd-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-63ead167-ca90-4f34-9804-1e7df23473cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-quobyte-23317039-e3a4-40f6-a527-a0587efd0d04" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-23317039-e3a4-40f6-a527-a0587efd0d04" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-quobyte-63ead167-ca90-4f34-9804-1e7df23473cd" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-63ead167-ca90-4f34-9804-1e7df23473cd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Deleting offline snapshot 63ead167-ca90-4f34-9804-1e7df23473cd of volume 23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] snapshot_file for this snap is: volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a208a-a29d-4df4-9f74-ca0d2ed62523]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:12 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd Apr 17 16:01:12 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:12 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23317039-e3a4-40f6-a527-a0587efd0d04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a744f630-cb65-4a7d-9734-af16aefe1016]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:12 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 Apr 17 16:01:12 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:13 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:13 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd Apr 17 16:01:13 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:13 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd" returned: 0 in 0.446s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:13 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd Apr 17 16:01:13 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:14 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04.63ead167-ca90-4f34-9804-1e7df23473cd" returned: 0 in 0.478s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-63ead167-ca90-4f34-9804-1e7df23473cd" released by "_delete_snapshot" :: held 1.906s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-23317039-e3a4-40f6-a527-a0587efd0d04" released by "delete_snapshot" :: held 1.921s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Created reservations ['ebc1a601-e1f3-4000-872b-93b362282c69', '5e43fafc-59f7-44ad-9e77-2f0cd2859057', '720e9c34-b1d6-4d5e-b404-124bd58abb54', '8a94de2f-d0fe-4dde-a956-03a4f081b064'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Delete snapshot completed successfully. Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-2307d8a4-1031-4147-9cac-7f05baf78a02 tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-63ead167-ca90-4f34-9804-1e7df23473cd-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-23317039-e3a4-40f6-a527-a0587efd0d04-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-23317039-e3a4-40f6-a527-a0587efd0d04-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-quobyte-23317039-e3a4-40f6-a527-a0587efd0d04" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-23317039-e3a4-40f6-a527-a0587efd0d04" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[480dd6a9-699e-4578-a385-d56463a0268c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:14 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 Apr 17 16:01:14 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:14 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04" returned: 0 in 0.563s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:14 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04 Apr 17 16:01:14 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:15 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-23317039-e3a4-40f6-a527-a0587efd0d04" returned: 0 in 0.392s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-23317039-e3a4-40f6-a527-a0587efd0d04" released by "delete_volume" :: held 0.996s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Created reservations ['bc58e5ff-bf43-4541-9ae4-ab1970a43f6e', '5fff59b9-d98d-4f0a-9613-2745a21f3adb', '087d65f7-577a-490b-aefb-56ab94e32bcf', '130a9326-dcd9-4b81-8dd3-18a04b46605c'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:15 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:15 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:15 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.439s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:15 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Deleted volume successfully. Apr 17 16:01:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d820dabb-f708-4d3a-899b-f333f0e7d1fc tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-23317039-e3a4-40f6-a527-a0587efd0d04-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-12da390f-8d96-41a0-b5d2-e63ec90784a4-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-12da390f-8d96-41a0-b5d2-e63ec90784a4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "cinder-quobyte-12da390f-8d96-41a0-b5d2-e63ec90784a4" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-12da390f-8d96-41a0-b5d2-e63ec90784a4" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb811e-f293-445b-a19b-1f1980429f14]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:16 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 Apr 17 16:01:16 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:16 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4" returned: 0 in 0.507s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:17 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4 Apr 17 16:01:17 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:17 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-12da390f-8d96-41a0-b5d2-e63ec90784a4" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-quobyte-12da390f-8d96-41a0-b5d2-e63ec90784a4" released by "delete_volume" :: held 0.982s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Created reservations ['9a92ba69-407e-473f-8de1-edc57c85d419', '0e4546c2-d013-4d83-9964-10a543c4720e', 'f890de2e-dafc-46dc-80a6-10731213e44b', 'ad21a714-6d2d-47f1-a192-8dfd79309083'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:17 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:17 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:17 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Deleted volume successfully. Apr 17 16:01:17 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-67721478-a96a-475d-8eda-33e273a678ef tempest-SnapshotDependencyTests-1672809384 None] Lock "cinder-12da390f-8d96-41a0-b5d2-e63ec90784a4-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Acquiring lock "cinder-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Lock "cinder-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Acquiring lock "cinder-quobyte-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Lock "cinder-quobyte-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d382d-0e94-4910-b05a-ca2b57c36a6f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:26 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef Apr 17 16:01:26 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:26 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef" returned: 0 in 0.452s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:26 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef Apr 17 16:01:26 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:27 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef" returned: 0 in 0.381s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Lock "cinder-quobyte-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef" released by "delete_volume" :: held 0.854s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Created reservations ['c4e1ec5b-a496-4169-8bb9-0f3974fca6ad', '532cc4a0-9b4e-434a-a574-93eb0b74311d', '95e400f9-05ac-42bc-b8d2-2bfd167dadf8', '71f210f1-0e25-4dc7-a634-256c14ea0abd'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:27 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:27 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:27 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.404s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:27 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Deleted volume successfully. Apr 17 16:01:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-606b1908-4190-4fdb-a99e-c4106049ec46 tempest-VolumesNegativeTest-1714226190 None] Lock "cinder-a9bc4fe3-6c9c-41ff-a7fe-7aac0faf4fef-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Flow 'volume_create_manager' (df4cdfb3-b40d-49d4-a5c9-cc93ae29eb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f70f2e-fb71-468c-ba2d-158a24503993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f70f2e-fb71-468c-ba2d-158a24503993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526de502-69f9-4f57-ac5e-6a5816d7fee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295e3262d3dc491d9aff02e21ac139e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:29Z,use_quota=True,user_id='7ab297fc3f0e4b83aabca609d01c3c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf2ae6c-ffe7-4a3f-8d0a-43abeabae262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf2ae6c-ffe7-4a3f-8d0a-43abeabae262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcb0502-2edd-4ec3-bfd0-f5fded442cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcb0502-2edd-4ec3-bfd0-f5fded442cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526de502-69f9-4f57-ac5e-6a5816d7fee5', 'volume_name': 'volume-526de502-69f9-4f57-ac5e-6a5816d7fee5', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabf935d-f057-493e-9386-2225c5f0207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabf935d-f057-493e-9386-2225c5f0207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659cde6d-7a64-45e0-9470-d40df1339505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:28 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Volume 526de502-69f9-4f57-ac5e-6a5816d7fee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526de502-69f9-4f57-ac5e-6a5816d7fee5', 'volume_size': 1} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526de502-69f9-4f57-ac5e-6a5816d7fee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295e3262d3dc491d9aff02e21ac139e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:29Z,use_quota=True,user_id='7ab297fc3f0e4b83aabca609d01c3c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Creating volume 526de502-69f9-4f57-ac5e-6a5816d7fee5 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:28 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:28 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 1073741824 Apr 17 16:01:28 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:29 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 1073741824" returned: 0 in 0.444s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:29 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 Apr 17 16:01:29 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:29 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5" returned: 0 in 0.386s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659cde6d-7a64-45e0-9470-d40df1339505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526de502-69f9-4f57-ac5e-6a5816d7fee5', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fbe653-12f3-4f51-8598-02716312bee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Volume volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 (526de502-69f9-4f57-ac5e-6a5816d7fee5): created successfully Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fbe653-12f3-4f51-8598-02716312bee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Flow 'volume_create_manager' (df4cdfb3-b40d-49d4-a5c9-cc93ae29eb76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-02a9f079-7019-438f-b822-880373ff24ae tempest-CinderUnicodeTest-1105014957 None] Created volume successfully. Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Flow 'volume_create_manager' (11e2f173-0ff9-4274-b072-73d79d8e309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280b3238-52a1-4204-9532-aeca9b2bc61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280b3238-52a1-4204-9532-aeca9b2bc61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1764109610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f249c3-81e9-4dbc-832c-6332fc74742f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295e3262d3dc491d9aff02e21ac139e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:30Z,use_quota=True,user_id='7ab297fc3f0e4b83aabca609d01c3c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee2f56e-4b3f-455d-9820-d6513d83eabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee2f56e-4b3f-455d-9820-d6513d83eabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd221a8c-7e13-4069-94d1-db2320826d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd221a8c-7e13-4069-94d1-db2320826d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f249c3-81e9-4dbc-832c-6332fc74742f', 'volume_name': 'volume-e9f249c3-81e9-4dbc-832c-6332fc74742f', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b1c9e7-582a-4547-a557-9a18fb055ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b1c9e7-582a-4547-a557-9a18fb055ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ed506d-43a4-4187-9168-7dfe3dee5a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Volume e9f249c3-81e9-4dbc-832c-6332fc74742f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f249c3-81e9-4dbc-832c-6332fc74742f', 'volume_size': 1} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1764109610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f249c3-81e9-4dbc-832c-6332fc74742f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295e3262d3dc491d9aff02e21ac139e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:30Z,use_quota=True,user_id='7ab297fc3f0e4b83aabca609d01c3c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Creating volume e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:29 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:29 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f 1073741824 Apr 17 16:01:29 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:30 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f 1073741824" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:30 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f Apr 17 16:01:30 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:30 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f" returned: 0 in 0.400s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ed506d-43a4-4187-9168-7dfe3dee5a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f249c3-81e9-4dbc-832c-6332fc74742f', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4302d9d3-77bc-4cb0-ba40-07fe33ef69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:30 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Volume volume-e9f249c3-81e9-4dbc-832c-6332fc74742f (e9f249c3-81e9-4dbc-832c-6332fc74742f): created successfully Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4302d9d3-77bc-4cb0-ba40-07fe33ef69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Flow 'volume_create_manager' (11e2f173-0ff9-4274-b072-73d79d8e309e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:30 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-afedcf93-3bd1-44d5-aa08-5fcde40fed7f tempest-CinderUnicodeTest-1105014957 None] Created volume successfully. Apr 17 16:01:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Creating offline snapshot 4d759764-ca82-4425-a2c3-1dbbcaea636c of volume e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:01:31 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fc4fad-87fc-4f29-998f-a21de450532d]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:31 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f Apr 17 16:01:31 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:31 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f" returned: 0 in 0.454s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:31 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c 1G Apr 17 16:01:31 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:32 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c 1G" returned: 0 in 0.459s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9f249c3-81e9-4dbc-832c-6332fc74742f -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:32 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9f249c3-81e9-4dbc-832c-6332fc74742f -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c Apr 17 16:01:32 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:32 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9f249c3-81e9-4dbc-832c-6332fc74742f -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c" returned: 0 in 0.415s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:32 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c is being set with open permissions: ugo+rw Apr 17 16:01:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:32 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c Apr 17 16:01:32 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:32 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c" returned: 0 in 0.400s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:32 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.info Apr 17 16:01:32 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:33 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.info" returned: 0 in 0.396s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:33 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.info is being set with open permissions: ugo+rw Apr 17 16:01:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:33 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.info Apr 17 16:01:33 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:33 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.info" returned: 0 in 0.384s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-766b3312-19f4-4d4f-a49c-96b17f1ac843 tempest-CinderUnicodeTest-1105014957 None] Create snapshot completed successfully Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "cinder-4d759764-ca82-4425-a2c3-1dbbcaea636c-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-4d759764-ca82-4425-a2c3-1dbbcaea636c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "cinder-quobyte-e9f249c3-81e9-4dbc-832c-6332fc74742f" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-e9f249c3-81e9-4dbc-832c-6332fc74742f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "cinder-quobyte-4d759764-ca82-4425-a2c3-1dbbcaea636c" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-4d759764-ca82-4425-a2c3-1dbbcaea636c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Deleting offline snapshot 4d759764-ca82-4425-a2c3-1dbbcaea636c of volume e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] snapshot_file for this snap is: volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[17030d12-9fe3-4eda-ac32-652b4c0c2fe7]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:34 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c Apr 17 16:01:34 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:34 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:34 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:34 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9f249c3-81e9-4dbc-832c-6332fc74742f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6635aaca-9842-4ab1-a0c1-1c1230479329]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:34 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.408s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:34 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f Apr 17 16:01:34 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:35 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f" returned: 0 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:35 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c Apr 17 16:01:35 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:35 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:35 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c Apr 17 16:01:35 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:36 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f.4d759764-ca82-4425-a2c3-1dbbcaea636c" returned: 0 in 0.390s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-4d759764-ca82-4425-a2c3-1dbbcaea636c" released by "_delete_snapshot" :: held 1.805s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-e9f249c3-81e9-4dbc-832c-6332fc74742f" released by "delete_snapshot" :: held 1.816s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Created reservations ['c90c8945-6306-4fcb-8c60-e04caa171232', 'e18adb17-1f07-4dcc-80c2-2d9f2f6fb9b8', 'a1126197-8e34-4ed0-ae2c-94e36612c149', 'ac951bb5-1fd2-4365-8a29-719fa5297502'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Delete snapshot completed successfully. Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3be7263d-7bb3-41df-85dd-2e516b900726 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-4d759764-ca82-4425-a2c3-1dbbcaea636c-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "cinder-e9f249c3-81e9-4dbc-832c-6332fc74742f-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-e9f249c3-81e9-4dbc-832c-6332fc74742f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "cinder-quobyte-e9f249c3-81e9-4dbc-832c-6332fc74742f" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-e9f249c3-81e9-4dbc-832c-6332fc74742f" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ef253-1a34-4432-a62e-62ef537f6d4a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:36 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f Apr 17 16:01:36 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:36 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f" returned: 0 in 0.440s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:36 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f Apr 17 16:01:36 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:37 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e9f249c3-81e9-4dbc-832c-6332fc74742f" returned: 0 in 0.381s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-e9f249c3-81e9-4dbc-832c-6332fc74742f" released by "delete_volume" :: held 0.854s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Created reservations ['324475ed-e1d8-4cb8-a7fc-17a2a3d3caac', '449822c2-44b7-4ab8-95d1-6b79caef1ddb', 'c5f0137c-7762-45e3-9a4f-40ec62ec6cea', 'd01bd16d-770b-484c-941b-66286badfe99'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:37 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:37 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "cinder-526de502-69f9-4f57-ac5e-6a5816d7fee5-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-526de502-69f9-4f57-ac5e-6a5816d7fee5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "cinder-quobyte-526de502-69f9-4f57-ac5e-6a5816d7fee5" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-526de502-69f9-4f57-ac5e-6a5816d7fee5" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02a1437-b610-4674-b387-8804f917f772]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:37 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 Apr 17 16:01:37 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:37 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.427s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:37 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Deleted volume successfully. Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-37972578-e8ba-448d-bc67-66e7f3018761 tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-e9f249c3-81e9-4dbc-832c-6332fc74742f-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:37 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5" returned: 0 in 0.459s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:37 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5 Apr 17 16:01:37 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:38 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-526de502-69f9-4f57-ac5e-6a5816d7fee5" returned: 0 in 0.385s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-quobyte-526de502-69f9-4f57-ac5e-6a5816d7fee5" released by "delete_volume" :: held 0.876s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Created reservations ['f949de5a-0fcd-401d-bfe8-0779ceecf3c9', 'a9c1d67d-a4c0-4146-b124-2ddafadebd73', 'a7d4ca95-a091-42c0-8091-714310c0e6db', 'cacc6597-3962-4abd-906c-09436de6bd6f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:38 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:38 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:38 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.433s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:38 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Deleted volume successfully. Apr 17 16:01:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ad380560-fe31-411f-b0c5-de79b7015a5b tempest-CinderUnicodeTest-1105014957 None] Lock "cinder-526de502-69f9-4f57-ac5e-6a5816d7fee5-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Flow 'volume_create_manager' (4eacd5ef-7b8a-459c-a57a-46ba8ee747e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3868876-0aaf-4442-ace5-55876572bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3868876-0aaf-4442-ace5-55876572bb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4034ac42-5964-42cc-aa5e-adbdee45dcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f3a404144e4ed2870a80e2d872bab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:45Z,use_quota=True,user_id='75065c603f5741058544398e138dbc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eb7580-37ca-44db-8415-f1e95ca86451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eb7580-37ca-44db-8415-f1e95ca86451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57165e29-7eb0-43aa-a530-c181eeaeb5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57165e29-7eb0-43aa-a530-c181eeaeb5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4034ac42-5964-42cc-aa5e-adbdee45dcd8', 'volume_name': 'volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3496b7e0-25b2-4e06-8d2d-c24831b78698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3496b7e0-25b2-4e06-8d2d-c24831b78698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95debf3-8d7c-45a6-8b39-c0cfa714581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Volume 4034ac42-5964-42cc-aa5e-adbdee45dcd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8', 'volume_size': 1} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4034ac42-5964-42cc-aa5e-adbdee45dcd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f3a404144e4ed2870a80e2d872bab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:45Z,use_quota=True,user_id='75065c603f5741058544398e138dbc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Creating volume 4034ac42-5964-42cc-aa5e-adbdee45dcd8 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:45 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:45 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 1073741824 Apr 17 16:01:45 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (617b6e3c-a005-4961-9047-78912eb7a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16d22ea-26cc-4445-a6d0-00df0edb808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16d22ea-26cc-4445-a6d0-00df0edb808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-395018215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236f3d24-958e-4959-8391-269c6ba89f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eac1f2c15d41c98c474bac156cb906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:45Z,use_quota=True,user_id='8c4c04122fe4423bafbc512929fbbb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0912da5f-2dc3-4e81-aa4d-e552e6212b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0912da5f-2dc3-4e81-aa4d-e552e6212b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445fa77a-512a-4cd4-a8e2-e5da8b1bf5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445fa77a-512a-4cd4-a8e2-e5da8b1bf5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236f3d24-958e-4959-8391-269c6ba89f1b', 'volume_name': 'volume-236f3d24-958e-4959-8391-269c6ba89f1b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7be825-5a3e-4013-926f-e2060f9382e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7be825-5a3e-4013-926f-e2060f9382e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ce9f9d-7a89-46f4-be3e-fe8a26cff99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Volume 236f3d24-958e-4959-8391-269c6ba89f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236f3d24-958e-4959-8391-269c6ba89f1b', 'volume_size': 1} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (acaf5371-67f2-43c8-881e-c2b987755de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b9c90e-9798-4562-bd5c-16f2d5fd7391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b9c90e-9798-4562-bd5c-16f2d5fd7391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193853636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51731587-a4d5-432f-8627-3feb50408795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:45Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04f6adf-6745-40bb-8924-10a8ac899333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04f6adf-6745-40bb-8924-10a8ac899333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea89f948-c94c-40b7-adb8-a3f13ddb352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea89f948-c94c-40b7-adb8-a3f13ddb352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51731587-a4d5-432f-8627-3feb50408795', 'volume_name': 'volume-51731587-a4d5-432f-8627-3feb50408795', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b45734-3e2d-4383-8dbb-92161fefda8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b45734-3e2d-4383-8dbb-92161fefda8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852aad53-3f29-49f0-9888-654b74451939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Volume 51731587-a4d5-432f-8627-3feb50408795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51731587-a4d5-432f-8627-3feb50408795', 'volume_size': 1} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (e1f2dfbd-51dc-4846-8fec-96a809b85691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75513044-ca20-4a68-b6bd-dfba94d3777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75513044-ca20-4a68-b6bd-dfba94d3777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1357622832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e5c315-9e21-42a5-8064-5fb1afe079ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e9ea49-adc2-4f01-8921-5397b0436485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e9ea49-adc2-4f01-8921-5397b0436485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fb08e5-e4e7-45bf-8c0e-8853d39d05df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fb08e5-e4e7-45bf-8c0e-8853d39d05df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e5c315-9e21-42a5-8064-5fb1afe079ed', 'volume_name': 'volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a908e6f-f1da-4d7e-ab99-80ef6a7de51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a908e6f-f1da-4d7e-ab99-80ef6a7de51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12af854f-4df0-4800-8854-4726ede15df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume a1e5c315-9e21-42a5-8064-5fb1afe079ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed', 'volume_size': 1} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (eb45644b-afd3-4804-8bc7-32da6b199ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c4bf21-fb2c-40aa-9003-da9d36c95a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c4bf21-fb2c-40aa-9003-da9d36c95a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086757520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414652bd-1e8a-4316-816e-59c660c814a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddada5d-29ea-4238-8cb8-9e0f3ea8ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddada5d-29ea-4238-8cb8-9e0f3ea8ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630adfff-bd8b-42ae-a9b5-a2ed44f22a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630adfff-bd8b-42ae-a9b5-a2ed44f22a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414652bd-1e8a-4316-816e-59c660c814a6', 'volume_name': 'volume-414652bd-1e8a-4316-816e-59c660c814a6', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e87cb63-3678-4f21-be3e-832bd48cca25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e87cb63-3678-4f21-be3e-832bd48cca25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:45 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8339b9-7abc-4b45-866d-9ee70f32156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:45 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Volume 414652bd-1e8a-4316-816e-59c660c814a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414652bd-1e8a-4316-816e-59c660c814a6', 'volume_size': 1} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 1073741824" returned: 0 in 0.607s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:45 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 Apr 17 16:01:45 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (fac0b56f-258d-43b4-8fcc-f643fc46456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021c510f-0927-4bc7-b2c5-229344ba2f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021c510f-0927-4bc7-b2c5-229344ba2f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-13376653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5f372f-576c-40fd-aa8a-290231ff41c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddc2eaa-424a-46f7-b8db-760f28e27221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddc2eaa-424a-46f7-b8db-760f28e27221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0b3331-7c9f-4f37-8614-aadd0f4cc5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0b3331-7c9f-4f37-8614-aadd0f4cc5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5f372f-576c-40fd-aa8a-290231ff41c9', 'volume_name': 'volume-eb5f372f-576c-40fd-aa8a-290231ff41c9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fa8705-9a85-4055-99ff-a501d74bff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fa8705-9a85-4055-99ff-a501d74bff9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb2176b-73fd-4652-bc6f-eec15ea1d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Volume eb5f372f-576c-40fd-aa8a-290231ff41c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5f372f-576c-40fd-aa8a-290231ff41c9', 'volume_size': 1} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (ba4ff164-dbb2-40ad-aa0a-64d37359b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c024c81a-33af-4b34-b457-e53a1c2c9005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c024c81a-33af-4b34-b457-e53a1c2c9005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-912741249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b159a93b-532d-4be0-8af1-5251d3e5a63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7fc574-e550-4134-be64-b10fc914f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7fc574-e550-4134-be64-b10fc914f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ea0621-196b-438f-a486-b66cdfa94e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ea0621-196b-438f-a486-b66cdfa94e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b159a93b-532d-4be0-8af1-5251d3e5a63b', 'volume_name': 'volume-b159a93b-532d-4be0-8af1-5251d3e5a63b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442b575-0b59-4b99-8742-214cf1977469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442b575-0b59-4b99-8742-214cf1977469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e566f819-6bbb-42c8-bd0a-76c5e55c0b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Volume b159a93b-532d-4be0-8af1-5251d3e5a63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b159a93b-532d-4be0-8af1-5251d3e5a63b', 'volume_size': 1} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (06f49bde-7d47-4350-8555-71e205557113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135de9b1-31fb-421a-8496-d14d84f14d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135de9b1-31fb-421a-8496-d14d84f14d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115421264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630e58bc-30ef-474d-bd20-87ea14de2e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff27cea-26cf-48d9-a69a-3090ffb2017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff27cea-26cf-48d9-a69a-3090ffb2017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae95c50-0725-484b-9b3d-d6e9dd0afbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae95c50-0725-484b-9b3d-d6e9dd0afbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630e58bc-30ef-474d-bd20-87ea14de2e0f', 'volume_name': 'volume-630e58bc-30ef-474d-bd20-87ea14de2e0f', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6719ef43-34aa-4352-b5d9-5d6809f10dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6719ef43-34aa-4352-b5d9-5d6809f10dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573da5a7-de82-4e36-959f-31142f1797aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Volume 630e58bc-30ef-474d-bd20-87ea14de2e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630e58bc-30ef-474d-bd20-87ea14de2e0f', 'volume_size': 1} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.029s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-395018215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236f3d24-958e-4959-8391-269c6ba89f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eac1f2c15d41c98c474bac156cb906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:45Z,use_quota=True,user_id='8c4c04122fe4423bafbc512929fbbb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Creating volume 236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:46 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95debf3-8d7c-45a6-8b39-c0cfa714581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d528363f-4d63-4821-aad4-3431f2a548a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b 1073741824 Apr 17 16:01:46 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Volume volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 (4034ac42-5964-42cc-aa5e-adbdee45dcd8): created successfully Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d528363f-4d63-4821-aad4-3431f2a548a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Flow 'volume_create_manager' (4eacd5ef-7b8a-459c-a57a-46ba8ee747e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e8a7509e-26ad-4127-82bb-75af1b8a2f68 tempest-CinderUnicodeTest-1052384875 None] Created volume successfully. Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Flow 'volume_create_manager' (140659b8-fba6-473b-9f1c-e33df2b1539f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7ca9ba-c857-4c68-903a-89d75dbca3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7ca9ba-c857-4c68-903a-89d75dbca3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2141182645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c64586e-7bfc-48c8-b564-0cf37088f390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f3a404144e4ed2870a80e2d872bab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:47Z,use_quota=True,user_id='75065c603f5741058544398e138dbc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77b019f-d949-4c9d-a8e0-6d4314aaf77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77b019f-d949-4c9d-a8e0-6d4314aaf77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c815d33d-8a93-4567-99de-cbe9ad54d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c815d33d-8a93-4567-99de-cbe9ad54d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c64586e-7bfc-48c8-b564-0cf37088f390', 'volume_name': 'volume-7c64586e-7bfc-48c8-b564-0cf37088f390', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b6ede8-8e21-412e-a28b-960f8823459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b6ede8-8e21-412e-a28b-960f8823459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f440455b-7c38-43f3-a0f0-12658bc48c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:46 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Volume 7c64586e-7bfc-48c8-b564-0cf37088f390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c64586e-7bfc-48c8-b564-0cf37088f390', 'volume_size': 1} Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:46 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b 1073741824" returned: 0 in 0.558s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:47 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b Apr 17 16:01:47 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:47 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b" returned: 0 in 0.417s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.837s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193853636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51731587-a4d5-432f-8627-3feb50408795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:45Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Creating volume 51731587-a4d5-432f-8627-3feb50408795 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:47 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ce9f9d-7a89-46f4-be3e-fe8a26cff99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236f3d24-958e-4959-8391-269c6ba89f1b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7ebb14-f8de-470f-a738-e2232b29cdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:47 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 1073741824 Apr 17 16:01:47 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:47 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Volume volume-236f3d24-958e-4959-8391-269c6ba89f1b (236f3d24-958e-4959-8391-269c6ba89f1b): created successfully Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7ebb14-f8de-470f-a738-e2232b29cdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (617b6e3c-a005-4961-9047-78912eb7a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:47 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-04d221e9-22bb-4c6d-8ad5-ec8f7f0bde0b tempest-VolumeDependencyTests-1799001644 None] Created volume successfully. Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:47 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 1073741824" returned: 0 in 0.490s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:47 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:47 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 Apr 17 16:01:47 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:48 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795" returned: 0 in 0.383s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1357622832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e5c315-9e21-42a5-8064-5fb1afe079ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Creating volume a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:48 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852aad53-3f29-49f0-9888-654b74451939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51731587-a4d5-432f-8627-3feb50408795', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:48 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed 1073741824 Apr 17 16:01:48 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578db435-fc3a-46a1-a1ee-6bf12c4aff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:48 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Volume volume-51731587-a4d5-432f-8627-3feb50408795 (51731587-a4d5-432f-8627-3feb50408795): created successfully Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578db435-fc3a-46a1-a1ee-6bf12c4aff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (acaf5371-67f2-43c8-881e-c2b987755de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:48 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-332a67e7-c529-461e-a364-1b061b15c56b tempest-CreateVolumesFromImageTest-1606096658 None] Created volume successfully. Apr 17 16:01:48 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed 1073741824" returned: 0 in 0.466s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:48 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:48 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed Apr 17 16:01:48 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:49 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed" returned: 0 in 0.399s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.331s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086757520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414652bd-1e8a-4316-816e-59c660c814a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Creating volume 414652bd-1e8a-4316-816e-59c660c814a6 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:49 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12af854f-4df0-4800-8854-4726ede15df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f80aa5-f284-4d1e-8019-1c8312beb1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:49 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 1073741824 Apr 17 16:01:49 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:49 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed (a1e5c315-9e21-42a5-8064-5fb1afe079ed): created successfully Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f80aa5-f284-4d1e-8019-1c8312beb1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (e1f2dfbd-51dc-4846-8fec-96a809b85691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:49 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1056ed0e-bba8-4689-8101-d9963b7841be tempest-CreateVolumesFromSnapshotTest-198911694 None] Created volume successfully. Apr 17 16:01:49 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 1073741824" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:49 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 Apr 17 16:01:49 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:49 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:50 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6" returned: 0 in 0.413s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.044s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-13376653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5f372f-576c-40fd-aa8a-290231ff41c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Creating volume eb5f372f-576c-40fd-aa8a-290231ff41c9 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:50 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8339b9-7abc-4b45-866d-9ee70f32156b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414652bd-1e8a-4316-816e-59c660c814a6', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:50 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 1073741824 Apr 17 16:01:50 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e94e9e-eed0-4ba9-a4c6-40aad0629475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:50 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Volume volume-414652bd-1e8a-4316-816e-59c660c814a6 (414652bd-1e8a-4316-816e-59c660c814a6): created successfully Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e94e9e-eed0-4ba9-a4c6-40aad0629475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (eb45644b-afd3-4804-8bc7-32da6b199ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:50 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-7f482f52-e9fc-486c-be06-b12f5f9c1819 tempest-CreateVolumesFromImageTest-1606096658 None] Created volume successfully. Apr 17 16:01:50 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 1073741824" returned: 0 in 0.471s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:50 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:50 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 Apr 17 16:01:50 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:51 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9" returned: 0 in 0.396s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.800s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-912741249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b159a93b-532d-4be0-8af1-5251d3e5a63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Creating volume b159a93b-532d-4be0-8af1-5251d3e5a63b {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:51 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb2176b-73fd-4652-bc6f-eec15ea1d904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5f372f-576c-40fd-aa8a-290231ff41c9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:51 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b 1073741824 Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79694842-c643-4b62-bde7-6623fd547f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:51 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:51 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Volume volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 (eb5f372f-576c-40fd-aa8a-290231ff41c9): created successfully Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79694842-c643-4b62-bde7-6623fd547f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (fac0b56f-258d-43b4-8fcc-f643fc46456d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-18e16c3a-a2fb-4df2-95fb-4643feb206ee tempest-CreateVolumesFromImageTest-1606096658 None] Created volume successfully. Apr 17 16:01:51 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b 1073741824" returned: 0 in 0.444s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:51 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b Apr 17 16:01:51 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:51 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b" returned: 0 in 0.413s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.503s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115421264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630e58bc-30ef-474d-bd20-87ea14de2e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00762e20e93045a4b71254b48f89b3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:46Z,use_quota=True,user_id='a8b12ca878284775ad163a2f90010ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Creating volume 630e58bc-30ef-474d-bd20-87ea14de2e0f {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:51 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e566f819-6bbb-42c8-bd0a-76c5e55c0b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b159a93b-532d-4be0-8af1-5251d3e5a63b', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:51 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f 1073741824 Apr 17 16:01:51 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39978249-ecaf-4132-b74a-8d13b421c308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:51 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Volume volume-b159a93b-532d-4be0-8af1-5251d3e5a63b (b159a93b-532d-4be0-8af1-5251d3e5a63b): created successfully Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39978249-ecaf-4132-b74a-8d13b421c308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:51 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (ba4ff164-dbb2-40ad-aa0a-64d37359b945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:51 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-2d383c2b-9dd6-4abc-98cf-3365674c37db tempest-CreateVolumesFromImageTest-1606096658 None] Created volume successfully. Apr 17 16:01:52 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f 1073741824" returned: 0 in 0.470s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:52 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f Apr 17 16:01:52 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:52 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f" returned: 0 in 0.390s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.891s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2141182645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c64586e-7bfc-48c8-b564-0cf37088f390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f3a404144e4ed2870a80e2d872bab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:47Z,use_quota=True,user_id='75065c603f5741058544398e138dbc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Creating volume 7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:01:52 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573da5a7-de82-4e36-959f-31142f1797aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630e58bc-30ef-474d-bd20-87ea14de2e0f', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:52 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 1073741824 Apr 17 16:01:52 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058ed091-dd36-4fc6-b92c-f2bcd713b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:52 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Volume volume-630e58bc-30ef-474d-bd20-87ea14de2e0f (630e58bc-30ef-474d-bd20-87ea14de2e0f): created successfully Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058ed091-dd36-4fc6-b92c-f2bcd713b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:52 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Flow 'volume_create_manager' (06f49bde-7d47-4350-8555-71e205557113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:52 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-60e8fd4d-47d9-4fea-ba8d-a5e6bab587bc tempest-CreateVolumesFromImageTest-1606096658 None] Created volume successfully. Apr 17 16:01:53 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 1073741824" returned: 0 in 0.465s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:53 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 Apr 17 16:01:53 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:53 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390" returned: 0 in 0.381s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.918s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Creating offline snapshot 6d748871-5c44-411f-bea4-3900d915066b of volume 236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f440455b-7c38-43f3-a0f0-12658bc48c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c64586e-7bfc-48c8-b564-0cf37088f390', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e719a9-83e5-4c90-8414-f5753949c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9549cc21-5d7c-48ce-b32f-e256655e694f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:53 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Volume volume-7c64586e-7bfc-48c8-b564-0cf37088f390 (7c64586e-7bfc-48c8-b564-0cf37088f390): created successfully Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e719a9-83e5-4c90-8414-f5753949c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Flow 'volume_create_manager' (140659b8-fba6-473b-9f1c-e33df2b1539f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:53 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f379ccb9-e6f0-485a-8788-3eef7a2cee62 tempest-CinderUnicodeTest-1052384875 None] Created volume successfully. Apr 17 16:01:53 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b Apr 17 16:01:53 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-630e58bc-30ef-474d-bd20-87ea14de2e0f-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-630e58bc-30ef-474d-bd20-87ea14de2e0f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-quobyte-630e58bc-30ef-474d-bd20-87ea14de2e0f" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-630e58bc-30ef-474d-bd20-87ea14de2e0f" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[49539cf9-b769-4a36-b744-1bf45e57524f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:53 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:54 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f Apr 17 16:01:54 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:54 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b" returned: 0 in 0.536s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:54 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b 1G Apr 17 16:01:54 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:54 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f" returned: 0 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:54 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f Apr 17 16:01:54 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:54 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b 1G" returned: 0 in 0.463s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236f3d24-958e-4959-8391-269c6ba89f1b -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:54 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236f3d24-958e-4959-8391-269c6ba89f1b -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b Apr 17 16:01:54 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:54 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-630e58bc-30ef-474d-bd20-87ea14de2e0f" returned: 0 in 0.414s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-630e58bc-30ef-474d-bd20-87ea14de2e0f" released by "delete_volume" :: held 0.925s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Created reservations ['3799521b-755f-4f43-a370-1a9222e4ca15', 'bcda699c-db83-45a1-b08f-d6ceaec9d90f', '6db0b02a-9135-46c1-819c-8bc7c8058f36', 'ce12ed63-f950-40da-bb6b-1a7323c85f67'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:54 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:55 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:55 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-b159a93b-532d-4be0-8af1-5251d3e5a63b-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-b159a93b-532d-4be0-8af1-5251d3e5a63b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-quobyte-b159a93b-532d-4be0-8af1-5251d3e5a63b" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-b159a93b-532d-4be0-8af1-5251d3e5a63b" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba4d60b-4180-4e3c-8ad6-3debc50bcbdc]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:55 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236f3d24-958e-4959-8391-269c6ba89f1b -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b" returned: 0 in 0.438s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:55 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b is being set with open permissions: ugo+rw Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:55 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b Apr 17 16:01:55 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:55 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b Apr 17 16:01:55 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:55 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:55 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Deleted volume successfully. Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-89852da5-4b81-4cd4-9382-84c8a89861d5 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-630e58bc-30ef-474d-bd20-87ea14de2e0f-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:55 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b" returned: 0 in 0.413s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:55 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:55 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b Apr 17 16:01:55 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:55 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.info Apr 17 16:01:55 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:55 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b159a93b-532d-4be0-8af1-5251d3e5a63b" returned: 0 in 0.400s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:55 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-b159a93b-532d-4be0-8af1-5251d3e5a63b" released by "delete_volume" :: held 0.904s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:56 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.info" returned: 0 in 0.412s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:56 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.info is being set with open permissions: ugo+rw Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:56 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.info Apr 17 16:01:56 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Created reservations ['85f0d201-c9ef-40f5-a9f4-715e48246692', '942be764-d6d4-429b-9d63-2dbd4a28dd34', '3ed35115-660c-44f8-9ada-25e1449e73c5', '6744614b-3f74-4801-b27f-ee06776b5fd1'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:56 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:56 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-eb5f372f-576c-40fd-aa8a-290231ff41c9-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-eb5f372f-576c-40fd-aa8a-290231ff41c9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-quobyte-eb5f372f-576c-40fd-aa8a-290231ff41c9" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-eb5f372f-576c-40fd-aa8a-290231ff41c9" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54872a2-005d-472e-9ed9-ed47e7b96d85]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:56 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 Apr 17 16:01:56 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:56 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.info" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.538s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Creating offline snapshot 1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 of volume a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa9ad3e-7682-40f6-861c-9f3e646b03bb]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:56 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e0b8264a-d2d6-4e0a-ad6b-7e716b26d38f tempest-VolumeDependencyTests-1799001644 None] Create snapshot completed successfully Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:56 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:56 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Deleted volume successfully. Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-018e95d3-6f3d-4489-9866-2c6811a40d5a tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-b159a93b-532d-4be0-8af1-5251d3e5a63b-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:56 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed Apr 17 16:01:56 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:56 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9" returned: 0 in 0.480s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:56 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9 Apr 17 16:01:56 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:56 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed" returned: 0 in 0.458s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:56 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:56 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 1G Apr 17 16:01:56 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:57 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eb5f372f-576c-40fd-aa8a-290231ff41c9" returned: 0 in 0.392s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-eb5f372f-576c-40fd-aa8a-290231ff41c9" released by "delete_volume" :: held 0.892s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Created reservations ['b0edfea8-249a-42e7-8a17-d564621b19f9', '46f2dc7f-da5c-45dc-8fa2-807fb5fddb9b', 'bb4333d5-bd41-418d-856f-d79c99748bdb', 'd1570f12-73ac-45c2-8781-32a2538ec8bb'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:57 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:57 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-414652bd-1e8a-4316-816e-59c660c814a6-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-414652bd-1e8a-4316-816e-59c660c814a6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-quobyte-414652bd-1e8a-4316-816e-59c660c814a6" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-414652bd-1e8a-4316-816e-59c660c814a6" acquired by "delete_volume" :: waited 0.023s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (a0463b3e-d5a9-4547-abaa-f08aa00dcb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6183e73-c531-4002-99c2-fa785982b835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a9b3b4-0325-48a3-9358-0708b1623923]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6183e73-c531-4002-99c2-fa785982b835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-503996482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6137e5a6-3e75-4fc9-a1d4-d612a4a67531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eac1f2c15d41c98c474bac156cb906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d748871-5c44-411f-bea4-3900d915066b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:01:57Z,use_quota=True,user_id='8c4c04122fe4423bafbc512929fbbb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8310ff4d-be53-4059-8471-0c7cc8bcdec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8310ff4d-be53-4059-8471-0c7cc8bcdec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c496fec7-8467-4689-80f1-073186bf9d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c496fec7-8467-4689-80f1-073186bf9d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6137e5a6-3e75-4fc9-a1d4-d612a4a67531', 'volume_name': 'volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531', 'volume_size': 1, 'snapshot_id': '6d748871-5c44-411f-bea4-3900d915066b'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31407c03-309c-475e-86c7-63221b2fb959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31407c03-309c-475e-86c7-63221b2fb959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33b678e-1818-4141-8345-2ed7750b8aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:01:57 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Volume 6137e5a6-3e75-4fc9-a1d4-d612a4a67531: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531', 'volume_size': 1, 'snapshot_id': '6d748871-5c44-411f-bea4-3900d915066b'} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:57 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 Apr 17 16:01:57 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:57 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 1G" returned: 0 in 0.566s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:57 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 Apr 17 16:01:57 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:57 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:57 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Deleted volume successfully. Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-665a5ce0-3374-4062-8289-43ff3428d781 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-eb5f372f-576c-40fd-aa8a-290231ff41c9-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:57 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6" returned: 0 in 0.487s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:57 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6 Apr 17 16:01:57 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:57 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" returned: 0 in 0.409s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:57 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 is being set with open permissions: ugo+rw Apr 17 16:01:57 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:57 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 Apr 17 16:01:57 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:58 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-414652bd-1e8a-4316-816e-59c660c814a6" returned: 0 in 0.387s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-414652bd-1e8a-4316-816e-59c660c814a6" released by "delete_volume" :: held 0.923s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Created reservations ['11cb3637-dc1f-4e2b-9cf3-1d8ea3476f15', '388d8274-23fc-41c8-a1cc-8febdb3202dd', '9972a996-0cdc-4e1f-bc1b-971430115429', '87a02b3b-9571-41c5-a5fe-a6b8ea4a6a97'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:58 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" returned: 0 in 0.425s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:58 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:58 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-51731587-a4d5-432f-8627-3feb50408795-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-51731587-a4d5-432f-8627-3feb50408795-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:58 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.info Apr 17 16:01:58 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "cinder-quobyte-51731587-a4d5-432f-8627-3feb50408795" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-51731587-a4d5-432f-8627-3feb50408795" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92046a3-0155-43a6-9b40-f49bca0e93e0]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:58 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 Apr 17 16:01:58 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:58 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:58 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.477s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:58 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Deleted volume successfully. Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.info" returned: 0 in 0.465s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:58 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.info is being set with open permissions: ugo+rw Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-517032c9-9d9e-4ef3-9993-7e4f79a5ae04 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-414652bd-1e8a-4316-816e-59c660c814a6-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:58 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.info Apr 17 16:01:58 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:58 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:58 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:58 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795 Apr 17 16:01:58 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:59 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.info" returned: 0 in 0.404s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.915s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Creating offline snapshot 35fe0c0e-1361-495a-bfdd-3e06b2562915 of volume 7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:01:59 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-f0443cbb-c076-4a9d-9905-5a3ebdca95fc tempest-CreateVolumesFromSnapshotTest-198911694 None] Create snapshot completed successfully Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc36a3-0c43-4e10-a3a7-fa7973f5a920]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:59 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 Apr 17 16:01:59 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:59 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-51731587-a4d5-432f-8627-3feb50408795" returned: 0 in 0.492s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-quobyte-51731587-a4d5-432f-8627-3feb50408795" released by "delete_volume" :: held 0.997s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Created reservations ['4c167687-ab27-4dbf-9faa-92e774bd596e', '14b0251a-d232-46b3-84ca-a983fac24f3e', 'db4ccdd4-a627-4e45-864b-3fd0ff2df1b8', 'a7be1a8c-cbd5-4dcb-acb1-5f8dffface5c'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:59 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:01:59 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:59 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390" returned: 0 in 0.488s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:01:59 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 1G Apr 17 16:01:59 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:01:59 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.401s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:01:59 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Deleted volume successfully. Apr 17 16:01:59 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9813e649-a159-4fd9-a2b3-6afcf5d6f9c3 tempest-CreateVolumesFromImageTest-1606096658 None] Lock "cinder-51731587-a4d5-432f-8627-3feb50408795-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:00 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 1G" returned: 0 in 0.489s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c64586e-7bfc-48c8-b564-0cf37088f390 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:00 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c64586e-7bfc-48c8-b564-0cf37088f390 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 Apr 17 16:02:00 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (e5d24e73-19df-42e8-b295-8a40e8d986a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83e0a14-fe14-450c-95a1-38d700f6bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83e0a14-fe14-450c-95a1-38d700f6bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064664172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b40889-bd73-4c28-8856-61fec6707d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:00Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88c8ef9-6169-484c-a152-0975ef8fa65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88c8ef9-6169-484c-a152-0975ef8fa65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d427c1-ed03-4388-87a8-e225baf8d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d427c1-ed03-4388-87a8-e225baf8d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b40889-bd73-4c28-8856-61fec6707d16', 'volume_name': 'volume-72b40889-bd73-4c28-8856-61fec6707d16', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce17883-3278-46a6-b662-830fe157d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce17883-3278-46a6-b662-830fe157d304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3cbfc0-8477-4ea4-b4b1-6d2ed20a7efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume 72b40889-bd73-4c28-8856-61fec6707d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b40889-bd73-4c28-8856-61fec6707d16', 'volume_size': 1} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (4de6823f-5685-4b19-9d7f-895e6f588279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8ef9ac-b5d9-4ee2-ab6d-548133a508af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8ef9ac-b5d9-4ee2-ab6d-548133a508af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098227523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb4cbe4-000b-49a1-a005-f3a0902fbede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925b28d0-3617-4d04-9838-00d0531e7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925b28d0-3617-4d04-9838-00d0531e7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84172bd-84a9-401f-8223-57ac600ec269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84172bd-84a9-401f-8223-57ac600ec269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb4cbe4-000b-49a1-a005-f3a0902fbede', 'volume_name': 'volume-feb4cbe4-000b-49a1-a005-f3a0902fbede', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe5e1bc-fe51-443a-9e2e-172d8c2c1241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe5e1bc-fe51-443a-9e2e-172d8c2c1241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df375c06-6f2a-4aaa-a405-a9656c10fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:00 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume feb4cbe4-000b-49a1-a005-f3a0902fbede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb4cbe4-000b-49a1-a005-f3a0902fbede', 'volume_size': 1} Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:00 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c64586e-7bfc-48c8-b564-0cf37088f390 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915" returned: 0 in 0.646s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:00 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 is being set with open permissions: ugo+rw Apr 17 16:02:00 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:00 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 Apr 17 16:02:00 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (2e25af4b-67b1-44f8-8b87-959fdb4e92be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689c003d-9ffb-4303-970b-cd4b177af309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689c003d-9ffb-4303-970b-cd4b177af309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069247405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac37b02-d628-4023-98a7-42a15a58b488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb92fa3-b4c4-4e8e-81fa-525e73a6926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb92fa3-b4c4-4e8e-81fa-525e73a6926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abee9b40-f43c-49e7-a255-28f914c2c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abee9b40-f43c-49e7-a255-28f914c2c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac37b02-d628-4023-98a7-42a15a58b488', 'volume_name': 'volume-7ac37b02-d628-4023-98a7-42a15a58b488', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce844a2-8c13-4dca-9dac-21343d58a12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce844a2-8c13-4dca-9dac-21343d58a12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ff6e76-c4ff-4483-89b9-16a1dd6106bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume 7ac37b02-d628-4023-98a7-42a15a58b488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac37b02-d628-4023-98a7-42a15a58b488', 'volume_size': 1} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (0466da3f-221b-4afe-9914-b9ca9469d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd917fa-477a-4db7-bb53-5b00a4c1e1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd917fa-477a-4db7-bb53-5b00a4c1e1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374715263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cb2948-bdb6-4b1a-8a02-c623c22712b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08b730d-a631-4c8f-8f40-e896db78a469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08b730d-a631-4c8f-8f40-e896db78a469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f98fa85-29a0-4e43-9017-10a54e9215d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f98fa85-29a0-4e43-9017-10a54e9215d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4cb2948-bdb6-4b1a-8a02-c623c22712b9', 'volume_name': 'volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe757e4-74cd-41ac-941e-7da41531179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe757e4-74cd-41ac-941e-7da41531179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608a5443-b141-40bc-9616-1a1079f84a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume e4cb2948-bdb6-4b1a-8a02-c623c22712b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9', 'volume_size': 1} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (f6a3e8aa-bd72-4775-a41b-6cbd8a6cf8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a397c68e-52b3-4be6-b6f6-5feaae62606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a397c68e-52b3-4be6-b6f6-5feaae62606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-581577644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e89b8e1-9dee-4258-84db-6deb4a4e93e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe2a6da-f2e4-4955-bd31-f662496e1586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe2a6da-f2e4-4955-bd31-f662496e1586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb898de0-55ff-40d4-9f68-b49dbd995385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb898de0-55ff-40d4-9f68-b49dbd995385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e89b8e1-9dee-4258-84db-6deb4a4e93e3', 'volume_name': 'volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196459ff-7922-46a1-8ed9-cf83672f4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196459ff-7922-46a1-8ed9-cf83672f4529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58761cc6-c5de-4bd2-a907-d9514422e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:01 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume 7e89b8e1-9dee-4258-84db-6deb4a4e93e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3', 'volume_size': 1} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915" returned: 0 in 0.586s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:01 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:01 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.info Apr 17 16:02:01 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:02 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.info" returned: 0 in 0.470s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:02 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.info is being set with open permissions: ugo+rw Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:02 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.info Apr 17 16:02:02 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:02 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.info" returned: 0 in 0.406s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-6d748871-5c44-411f-bea4-3900d915066b-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:02 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-22350626-7005-4adc-a16f-71921a8086d4 tempest-CinderUnicodeTest-1052384875 None] Create snapshot completed successfully Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6d748871-5c44-411f-bea4-3900d915066b-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Creating volume 6137e5a6-3e75-4fc9-a1d4-d612a4a67531 from snapshot 6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] snapshot: 6d748871-5c44-411f-bea4-3900d915066b, volume: 6137e5a6-3e75-4fc9-a1d4-d612a4a67531, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (9e817c66-9dae-4bc0-a589-266c7c7d50ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b0cab4-3eaa-4cf2-8143-16733562bd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1617d4-d532-4f54-b3a9-4cc28f6334d6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b0cab4-3eaa-4cf2-8143-16733562bd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83457057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d3b763-80d4-4b94-97db-a1679ab43ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:02Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1fd75f-b45a-4cd1-89ca-345a6451df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1fd75f-b45a-4cd1-89ca-345a6451df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768548e5-b6ee-41ae-b453-10454f0a95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768548e5-b6ee-41ae-b453-10454f0a95b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d3b763-80d4-4b94-97db-a1679ab43ba3', 'volume_name': 'volume-75d3b763-80d4-4b94-97db-a1679ab43ba3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3851ae44-de4c-4121-9928-a3b10843cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3851ae44-de4c-4121-9928-a3b10843cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8565bf6-dccc-4b3a-b008-8f0a35ec7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:02 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume 75d3b763-80d4-4b94-97db-a1679ab43ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d3b763-80d4-4b94-97db-a1679ab43ba3', 'volume_size': 1} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "cinder-35fe0c0e-1361-495a-bfdd-3e06b2562915-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-35fe0c0e-1361-495a-bfdd-3e06b2562915-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "cinder-quobyte-7c64586e-7bfc-48c8-b564-0cf37088f390" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:02 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b Apr 17 16:02:02 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-7c64586e-7bfc-48c8-b564-0cf37088f390" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "cinder-quobyte-35fe0c0e-1361-495a-bfdd-3e06b2562915" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-35fe0c0e-1361-495a-bfdd-3e06b2562915" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Deleting offline snapshot 35fe0c0e-1361-495a-bfdd-3e06b2562915 of volume 7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] snapshot_file for this snap is: volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9bf4f4-c4ce-4b3a-a358-01445493e845]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:02 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:02 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 Apr 17 16:02:02 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:03 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b" returned: 0 in 0.465s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236f3d24-958e-4959-8391-269c6ba89f1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e419111a-e020-42df-8ac2-2b912b9296ce]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:03 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b Apr 17 16:02:03 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:03 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915" returned: 0 in 0.479s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c64586e-7bfc-48c8-b564-0cf37088f390(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f3346-8e33-44c2-a205-539febf5b7db]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:03 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 Apr 17 16:02:03 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:03 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b" returned: 0 in 0.484s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:03 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 Apr 17 16:02:03 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:03 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390" returned: 0 in 0.480s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:03 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:03 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 Apr 17 16:02:03 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:04 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915" returned: 0 in 0.856s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:04 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:04 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915 Apr 17 16:02:04 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:05 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390.35fe0c0e-1361-495a-bfdd-3e06b2562915" returned: 0 in 0.839s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-35fe0c0e-1361-495a-bfdd-3e06b2562915" released by "_delete_snapshot" :: held 2.730s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-7c64586e-7bfc-48c8-b564-0cf37088f390" released by "delete_snapshot" :: held 2.747s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Created reservations ['9bbc0cf0-155e-4400-a801-4afaf3ba524e', '1629eb34-e969-4fe5-a83e-834b926793a6', 'ff5c7cb7-a83e-48fa-8d10-378ef468ca2d', 'f4c1c139-ae30-4de4-98c3-8c1cda3ac197'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:05 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Delete snapshot completed successfully. Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-9b649b4b-dd64-4784-9e3c-e23658a68421 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-35fe0c0e-1361-495a-bfdd-3e06b2562915-delete_snapshot" released by "delete_snapshot" :: held 2.862s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:05 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" returned: 0 in 1.997s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6110d63c-5c53-41dc-a1c0-e159ab65a29f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:05 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b Apr 17 16:02:05 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "cinder-7c64586e-7bfc-48c8-b564-0cf37088f390-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-7c64586e-7bfc-48c8-b564-0cf37088f390-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "cinder-quobyte-7c64586e-7bfc-48c8-b564-0cf37088f390" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-7c64586e-7bfc-48c8-b564-0cf37088f390" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[241cd0db-f1d3-46b2-a88c-198ee67be872]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:05 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:05 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 Apr 17 16:02:05 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:06 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b" returned: 0 in 0.592s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:02:06 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Converted 1024.00 MB image at 512.64 MB/s Apr 17 16:02:06 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 is being set with open permissions: ugo+rw Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:06 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 Apr 17 16:02:06 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:06 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390" returned: 0 in 0.446s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:06 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390 Apr 17 16:02:06 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:06 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" returned: 0 in 0.390s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" released by "_copy_volume_from_snapshot" :: held 4.029s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6d748871-5c44-411f-bea4-3900d915066b-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" released by "_create_volume_from_snapshot" :: held 4.066s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.095s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.963s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064664172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b40889-bd73-4c28-8856-61fec6707d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:00Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Creating volume 72b40889-bd73-4c28-8856-61fec6707d16 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:06 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:06 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 1073741824 Apr 17 16:02:06 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33b678e-1818-4141-8345-2ed7750b8aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531', 'volume_size': 1, 'snapshot_id': '6d748871-5c44-411f-bea4-3900d915066b'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9873c871-9194-4d14-9de3-b8ae485f5513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:06 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Volume volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 (6137e5a6-3e75-4fc9-a1d4-d612a4a67531): created successfully Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9873c871-9194-4d14-9de3-b8ae485f5513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (a0463b3e-d5a9-4547-abaa-f08aa00dcb7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:06 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-196c84b6-0265-4ada-8a07-2e0d2cc12e7d tempest-VolumeDependencyTests-1799001644 None] Created volume successfully. Apr 17 16:02:06 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7c64586e-7bfc-48c8-b564-0cf37088f390" returned: 0 in 0.407s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-7c64586e-7bfc-48c8-b564-0cf37088f390" released by "delete_volume" :: held 0.879s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Created reservations ['87eec8fd-2175-445f-ad86-840de742b35a', 'e5f5af4d-d543-445d-bac5-310a55b95962', '2364b57f-f423-46c2-aa19-e6f57739558a', '069045f0-10d3-4760-87da-9c2468c1cdbf'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:06 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:06 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-6d748871-5c44-411f-bea4-3900d915066b-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-6d748871-5c44-411f-bea4-3900d915066b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-236f3d24-958e-4959-8391-269c6ba89f1b" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-236f3d24-958e-4959-8391-269c6ba89f1b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-6d748871-5c44-411f-bea4-3900d915066b" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6d748871-5c44-411f-bea4-3900d915066b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Deleting offline snapshot 6d748871-5c44-411f-bea4-3900d915066b of volume 236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] snapshot_file for this snap is: volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5cc330-1f72-46f2-9af6-10a67f5d1b5e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:06 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "cinder-4034ac42-5964-42cc-aa5e-adbdee45dcd8-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-4034ac42-5964-42cc-aa5e-adbdee45dcd8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "cinder-quobyte-4034ac42-5964-42cc-aa5e-adbdee45dcd8" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-4034ac42-5964-42cc-aa5e-adbdee45dcd8" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:07 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b Apr 17 16:02:07 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[503fdee6-5f4f-44a3-96f6-105221379071]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:07 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 1073741824" returned: 0 in 0.554s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:07 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 Apr 17 16:02:07 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:07 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 Apr 17 16:02:07 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:07 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.496s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:07 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Deleted volume successfully. Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6c0ea9eb-e1c2-4f80-87d8-350301fe5c33 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-7c64586e-7bfc-48c8-b564-0cf37088f390-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:07 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b" returned: 0 in 0.507s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236f3d24-958e-4959-8391-269c6ba89f1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d529d-95e2-4073-a66a-c75a84796de6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:07 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b Apr 17 16:02:07 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:07 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16" returned: 0 in 0.402s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.740s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098227523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb4cbe4-000b-49a1-a005-f3a0902fbede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Creating volume feb4cbe4-000b-49a1-a005-f3a0902fbede {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:07 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3cbfc0-8477-4ea4-b4b1-6d2ed20a7efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b40889-bd73-4c28-8856-61fec6707d16', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9c6a1b-22d6-47f7-a2e3-041bda025c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:07 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede 1073741824 Apr 17 16:02:07 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:07 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8" returned: 0 in 0.528s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:07 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume volume-72b40889-bd73-4c28-8856-61fec6707d16 (72b40889-bd73-4c28-8856-61fec6707d16): created successfully Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9c6a1b-22d6-47f7-a2e3-041bda025c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:07 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (e5d24e73-19df-42e8-b295-8a40e8d986a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:07 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8 Apr 17 16:02:07 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:07 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-16861b37-b881-4260-bac6-a781389193b3 tempest-CreateVolumesFromSnapshotTest-198911694 None] Created volume successfully. Apr 17 16:02:08 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b" returned: 0 in 0.541s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:08 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b Apr 17 16:02:08 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:08 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-4034ac42-5964-42cc-aa5e-adbdee45dcd8" returned: 0 in 0.455s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-quobyte-4034ac42-5964-42cc-aa5e-adbdee45dcd8" released by "delete_volume" :: held 1.015s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:08 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede 1073741824" returned: 0 in 0.509s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Created reservations ['3c41cef0-829a-40f1-97c7-c0530b6ff39d', 'bbc388b3-9790-411e-b30b-6f6121bd24f2', '7bd953a3-2883-4459-8fda-3eb72427c2f2', 'aa6b99aa-f498-445f-a584-1371f05ccd9f'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:08 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede Apr 17 16:02:08 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:08 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:08 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:08 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b" returned: 0 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:08 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b Apr 17 16:02:08 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:08 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede" returned: 0 in 0.406s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.452s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069247405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac37b02-d628-4023-98a7-42a15a58b488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Creating volume 7ac37b02-d628-4023-98a7-42a15a58b488 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:08 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df375c06-6f2a-4aaa-a405-a9656c10fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb4cbe4-000b-49a1-a005-f3a0902fbede', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d051b6c-ac1d-4bfe-830b-d3f9949641eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:08 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 1073741824 Apr 17 16:02:08 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:08 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume volume-feb4cbe4-000b-49a1-a005-f3a0902fbede (feb4cbe4-000b-49a1-a005-f3a0902fbede): created successfully Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d051b6c-ac1d-4bfe-830b-d3f9949641eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (4de6823f-5685-4b19-9d7f-895e6f588279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-10ec8ed0-ef27-427e-a6c2-6b988b1a4d28 tempest-CreateVolumesFromSnapshotTest-198911694 None] Created volume successfully. Apr 17 16:02:08 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:08 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Deleted volume successfully. Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-6b4da30a-8257-4064-befa-f77e0a0b45d1 tempest-CinderUnicodeTest-1052384875 None] Lock "cinder-4034ac42-5964-42cc-aa5e-adbdee45dcd8-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:08 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b.6d748871-5c44-411f-bea4-3900d915066b" returned: 0 in 0.424s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6d748871-5c44-411f-bea4-3900d915066b" released by "_delete_snapshot" :: held 1.969s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-236f3d24-958e-4959-8391-269c6ba89f1b" released by "delete_snapshot" :: held 1.980s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:08 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Created reservations ['e6d578d5-3dc6-40cc-92e3-51e3a9dd4c52', 'da6af737-61a2-45a8-b531-040bbfe8a435', '6fa48393-a1c8-41a4-b009-40282781a7f1', '06fff2f7-98c2-4221-93cf-067aae9f6c69'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Delete snapshot completed successfully. Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-080b2401-cc22-4ce1-b03b-458d72ea519e tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-6d748871-5c44-411f-bea4-3900d915066b-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-236f3d24-958e-4959-8391-269c6ba89f1b-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-236f3d24-958e-4959-8391-269c6ba89f1b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-236f3d24-958e-4959-8391-269c6ba89f1b" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-236f3d24-958e-4959-8391-269c6ba89f1b" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:09 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 1073741824" returned: 0 in 0.546s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[17426696-40e0-409f-a2bc-3f3d4f1ed8d2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:09 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 Apr 17 16:02:09 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:09 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b Apr 17 16:02:09 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:09 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.376s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374715263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cb2948-bdb6-4b1a-8a02-c623c22712b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Creating volume e4cb2948-bdb6-4b1a-8a02-c623c22712b9 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:09 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ff6e76-c4ff-4483-89b9-16a1dd6106bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac37b02-d628-4023-98a7-42a15a58b488', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54453f8-66d1-41aa-922a-88632cac8e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:09 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:09 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 1073741824 Apr 17 16:02:09 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b" returned: 0 in 0.580s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:09 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume volume-7ac37b02-d628-4023-98a7-42a15a58b488 (7ac37b02-d628-4023-98a7-42a15a58b488): created successfully Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54453f8-66d1-41aa-922a-88632cac8e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:09 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (2e25af4b-67b1-44f8-8b87-959fdb4e92be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:09 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b Apr 17 16:02:09 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:09 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-1d00af87-48dc-4218-8799-82b443ae04d5 tempest-CreateVolumesFromSnapshotTest-198911694 None] Created volume successfully. Apr 17 16:02:10 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-236f3d24-958e-4959-8391-269c6ba89f1b" returned: 0 in 0.562s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-236f3d24-958e-4959-8391-269c6ba89f1b" released by "delete_volume" :: held 1.183s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:10 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 1073741824" returned: 0 in 0.608s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Created reservations ['41e5b4d0-2203-489d-8761-f39e69b7b07c', '4f621c2a-ca15-49c2-9905-499347dcb0d4', 'b1d3796c-5700-4415-b7bb-7dad9d2de009', 'd2e05b56-d1b9-4be5-9f2e-a838d5c0903c'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:10 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 Apr 17 16:02:10 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:10 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:10 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:10 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9" returned: 0 in 0.472s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.245s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-581577644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e89b8e1-9dee-4258-84db-6deb4a4e93e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024af5d32aa4831a1ec19a6a2f45a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:01Z,use_quota=True,user_id='bf0ffc1982c44c729cc9bbe2809bc541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Creating volume 7e89b8e1-9dee-4258-84db-6deb4a4e93e3 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:10 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:10 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:10 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 1073741824 Apr 17 16:02:10 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608a5443-b141-40bc-9616-1a1079f84a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf76504-12fa-4703-860c-5f75ef6f42fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.478s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Deleted volume successfully. Apr 17 16:02:10 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 (e4cb2948-bdb6-4b1a-8a02-c623c22712b9): created successfully Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf76504-12fa-4703-860c-5f75ef6f42fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (0466da3f-221b-4afe-9914-b9ca9469d22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:10 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-26a97b0d-199b-4f61-b576-d8bac3ebc5dc tempest-CreateVolumesFromSnapshotTest-198911694 None] Created volume successfully. Apr 17 16:02:10 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e483da74-3c9d-46ad-9ef6-6c0958a65700 tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-236f3d24-958e-4959-8391-269c6ba89f1b-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:11 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 1073741824" returned: 0 in 0.674s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:UPDATE=184,cinder:DELETE=19,cinder:SELECT=129,cinder:INSERT=43 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=144,cinder:INSERT=44,cinder:UPDATE=180,cinder:DELETE=15 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:11 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 Apr 17 16:02:11 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (6d5939a1-0249-47a3-99a8-753d12216309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3650a9c-1a92-4f96-a559-137ba4724712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3650a9c-1a92-4f96-a559-137ba4724712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-807346817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9acd73e-8c90-4c8f-9fa0-905819f4501d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eac1f2c15d41c98c474bac156cb906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:11Z,use_quota=True,user_id='8c4c04122fe4423bafbc512929fbbb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f552db2-220d-408d-b892-55d78a3bc345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f552db2-220d-408d-b892-55d78a3bc345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4353bf89-8d3f-490a-85e7-0868a7ccd097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4353bf89-8d3f-490a-85e7-0868a7ccd097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9acd73e-8c90-4c8f-9fa0-905819f4501d', 'volume_name': 'volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3e17d4-2153-4690-b23f-5dd6ef642779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3e17d4-2153-4690-b23f-5dd6ef642779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0210335f-0cdb-4b88-ae4c-21704d69b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:11 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Volume a9acd73e-8c90-4c8f-9fa0-905819f4501d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d', 'volume_size': 1} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:11 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3" returned: 0 in 0.499s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.338s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83457057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d3b763-80d4-4b94-97db-a1679ab43ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:02Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Creating volume 75d3b763-80d4-4b94-97db-a1679ab43ba3 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:11 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:12 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:12 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 1073741824 Apr 17 16:02:12 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58761cc6-c5de-4bd2-a907-d9514422e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e45da9-4e56-4d8f-a223-77cc86ffa60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:12 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Volume volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 (7e89b8e1-9dee-4258-84db-6deb4a4e93e3): created successfully Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e45da9-4e56-4d8f-a223-77cc86ffa60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Flow 'volume_create_manager' (f6a3e8aa-bd72-4775-a41b-6cbd8a6cf8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:12 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-dd30b46c-5ea2-4477-b797-931ed6b08302 tempest-CreateVolumesFromSnapshotTest-198911694 None] Created volume successfully. Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-7e89b8e1-9dee-4258-84db-6deb4a4e93e3-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-7e89b8e1-9dee-4258-84db-6deb4a4e93e3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-7e89b8e1-9dee-4258-84db-6deb4a4e93e3" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-7e89b8e1-9dee-4258-84db-6deb4a4e93e3" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e207fe7-6fc6-4653-b5a1-68080268da3b]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:12 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 Apr 17 16:02:12 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:12 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 1073741824" returned: 0 in 0.609s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:12 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 Apr 17 16:02:12 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:12 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3" returned: 0 in 0.512s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:12 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:12 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3 Apr 17 16:02:12 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:13 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3" returned: 0 in 0.432s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.467s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-807346817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9acd73e-8c90-4c8f-9fa0-905819f4501d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eac1f2c15d41c98c474bac156cb906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:11Z,use_quota=True,user_id='8c4c04122fe4423bafbc512929fbbb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Creating volume a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:13 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8565bf6-dccc-4b3a-b008-8f0a35ec7d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d3b763-80d4-4b94-97db-a1679ab43ba3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff34e6a-d7bc-47d2-a73b-04779768f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:13 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d 1073741824 Apr 17 16:02:13 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:13 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 (75d3b763-80d4-4b94-97db-a1679ab43ba3): created successfully Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff34e6a-d7bc-47d2-a73b-04779768f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (9e817c66-9dae-4bc0-a589-266c7c7d50ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:13 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-339e48f7-5a4d-49a7-99c8-b53b4406b2e9 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created volume successfully. Apr 17 16:02:13 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7e89b8e1-9dee-4258-84db-6deb4a4e93e3" returned: 0 in 0.450s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-7e89b8e1-9dee-4258-84db-6deb4a4e93e3" released by "delete_volume" :: held 0.992s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Created reservations ['125f81d3-3c1a-4a37-865b-d16118a08650', '1bd35c69-e86b-4900-af34-4aa14857d99e', '746e4eec-a868-4489-8768-7be30dca14e4', '6269b7df-f0be-4134-bd2e-e4c5d8c5f6c3'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:13 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:13 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-e4cb2948-bdb6-4b1a-8a02-c623c22712b9-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-e4cb2948-bdb6-4b1a-8a02-c623c22712b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-e4cb2948-bdb6-4b1a-8a02-c623c22712b9" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-e4cb2948-bdb6-4b1a-8a02-c623c22712b9" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe11709-e497-4c65-8a93-0cfb0dec55c2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:13 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d 1073741824" returned: 0 in 0.614s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:13 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d Apr 17 16:02:13 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:13 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 Apr 17 16:02:13 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:13 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.474s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:13 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:13 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Deleted volume successfully. Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-341cdbb5-5726-471c-ac85-6eef41be0e3c tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-7e89b8e1-9dee-4258-84db-6deb4a4e93e3-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:14 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d" returned: 0 in 0.472s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0210335f-0cdb-4b88-ae4c-21704d69b38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669afe72-65a2-4be8-ab97-fc507b462335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Volume volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d (a9acd73e-8c90-4c8f-9fa0-905819f4501d): created successfully Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669afe72-65a2-4be8-ab97-fc507b462335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (6d5939a1-0249-47a3-99a8-753d12216309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:14 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-bd94f0dd-876d-4771-b6cf-b870f048f962 tempest-VolumeDependencyTests-1799001644 None] Created volume successfully. Apr 17 16:02:14 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9" returned: 0 in 0.599s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:14 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9 Apr 17 16:02:14 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (217b9db4-dd58-424c-9fea-a33053f274aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad96133-1ddd-4ab2-b3d6-75d8a9da8fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad96133-1ddd-4ab2-b3d6-75d8a9da8fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1886159411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c94de0-815a-4ebe-9784-310a13bd5038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0408a7-262c-4035-98d7-b35cffa14969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0408a7-262c-4035-98d7-b35cffa14969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d819b07-91d4-40fb-bf5b-9ef3f54a6f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d819b07-91d4-40fb-bf5b-9ef3f54a6f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c94de0-815a-4ebe-9784-310a13bd5038', 'volume_name': 'volume-b4c94de0-815a-4ebe-9784-310a13bd5038', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b38e3e-5b95-4878-8ebd-af3d3cc7bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b38e3e-5b95-4878-8ebd-af3d3cc7bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52554c5-9fdb-4df9-a6e3-29d05483b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume b4c94de0-815a-4ebe-9784-310a13bd5038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c94de0-815a-4ebe-9784-310a13bd5038', 'volume_size': 1} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1886159411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c94de0-815a-4ebe-9784-310a13bd5038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Creating volume b4c94de0-815a-4ebe-9784-310a13bd5038 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:14 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:14 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 1073741824 Apr 17 16:02:14 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (61f700f6-98d5-41fd-ae7a-53bb2543eb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7f3bde-2d52-47cc-b4ba-676ee953c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-e4cb2948-bdb6-4b1a-8a02-c623c22712b9" returned: 0 in 0.641s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7f3bde-2d52-47cc-b4ba-676ee953c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687425054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c82c70e-80af-41e4-9b36-2eecd53e2c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93852aa-f2b8-4a91-ad61-9f8a0ccfdcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93852aa-f2b8-4a91-ad61-9f8a0ccfdcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be3b53b-b69e-4881-80f2-6cef0116a066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be3b53b-b69e-4881-80f2-6cef0116a066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c82c70e-80af-41e4-9b36-2eecd53e2c2a', 'volume_name': 'volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:14 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff059fca-025f-4959-b4b9-fd3cf65192f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff059fca-025f-4959-b4b9-fd3cf65192f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe071c4-b477-4857-ac36-f485c099ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume 6c82c70e-80af-41e4-9b36-2eecd53e2c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a', 'volume_size': 1} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-e4cb2948-bdb6-4b1a-8a02-c623c22712b9" released by "delete_volume" :: held 1.354s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Created reservations ['4529d42c-5faa-4344-971c-d3799409dbbc', '7309a71f-ee09-456e-9f07-1566eb81f289', '841056d1-501a-40a5-a5d5-772e36d0fd69', '218b3791-3ca9-4ce8-ad85-251ed09cb108'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (1394771b-4e63-4a73-b45d-f28b6301164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aea2dd-556f-486b-9f7f-2e0b8008a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:15 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aea2dd-556f-486b-9f7f-2e0b8008a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-151900895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb64f3f8-fd84-4ce8-b432-3748d337a6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a460f7f-2240-44a0-becd-1405fb670943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a460f7f-2240-44a0-becd-1405fb670943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30534722-cd43-48b1-abe4-d17fa7b8e391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30534722-cd43-48b1-abe4-d17fa7b8e391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb64f3f8-fd84-4ce8-b432-3748d337a6dc', 'volume_name': 'volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b743b16d-158e-4434-92c6-05b6646f9c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b743b16d-158e-4434-92c6-05b6646f9c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788b5a6b-db29-4cb3-a445-e9341c0ebaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume bb64f3f8-fd84-4ce8-b432-3748d337a6dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc', 'volume_size': 1} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (2e376ce9-dd1f-4749-9c6b-562c2d005dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fab7a9-6055-4371-b897-65e0f336f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (20a8d1c1-330e-428a-b459-95b322f93cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c0c446-1ee1-4729-bb4a-c74338dc6738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fab7a9-6055-4371-b897-65e0f336f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500578755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab24ed1-da5e-442e-9251-292feb7b251a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eac1f2c15d41c98c474bac156cb906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a9acd73e-8c90-4c8f-9fa0-905819f4501d,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='8c4c04122fe4423bafbc512929fbbb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eba3839-814a-4256-93ec-7ec9018de331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eba3839-814a-4256-93ec-7ec9018de331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c7dfee-2d2b-4395-831a-a7d371da6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c7dfee-2d2b-4395-831a-a7d371da6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eab24ed1-da5e-442e-9251-292feb7b251a', 'volume_name': 'volume-eab24ed1-da5e-442e-9251-292feb7b251a', 'volume_size': 1, 'source_volid': 'a9acd73e-8c90-4c8f-9fa0-905819f4501d', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d08f017-072d-404b-a0fb-e7478f79d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d08f017-072d-404b-a0fb-e7478f79d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664aff0a-1d8d-4eef-8431-d67f22b70df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Volume eab24ed1-da5e-442e-9251-292feb7b251a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eab24ed1-da5e-442e-9251-292feb7b251a', 'volume_size': 1, 'source_volid': 'a9acd73e-8c90-4c8f-9fa0-905819f4501d', 'source_volstatus': 'available'} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c0c446-1ee1-4729-bb4a-c74338dc6738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004788373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce05d8ce-c327-4320-a103-640bdf1d3cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9756916e-1d55-49be-87aa-962a7759b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9756916e-1d55-49be-87aa-962a7759b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d240f7-94d0-49f3-991c-ea40023c03ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d240f7-94d0-49f3-991c-ea40023c03ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce05d8ce-c327-4320-a103-640bdf1d3cab', 'volume_name': 'volume-ce05d8ce-c327-4320-a103-640bdf1d3cab', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1298ba-b869-469e-adc7-09467193f820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1298ba-b869-469e-adc7-09467193f820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097904f1-7868-403c-b043-db70e8ba5328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume ce05d8ce-c327-4320-a103-640bdf1d3cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce05d8ce-c327-4320-a103-640bdf1d3cab', 'volume_size': 1} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (4d0a953e-db36-417c-bd1c-00d1f44d490d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197405d-5e7e-4d2b-bc18-5d91c7260bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197405d-5e7e-4d2b-bc18-5d91c7260bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104334492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90d6caf-3936-4df9-8f87-69a8328c92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:16Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2c53d2-47e2-49d5-bc4a-679f798b3e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2c53d2-47e2-49d5-bc4a-679f798b3e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da04f49c-3f93-4097-ae83-dbfc60c73bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da04f49c-3f93-4097-ae83-dbfc60c73bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90d6caf-3936-4df9-8f87-69a8328c92f3', 'volume_name': 'volume-c90d6caf-3936-4df9-8f87-69a8328c92f3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f2bada-40d6-4306-b5d3-3b1014ecaa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f2bada-40d6-4306-b5d3-3b1014ecaa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8356d-e310-4fd1-98f7-1d307572e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:15 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume c90d6caf-3936-4df9-8f87-69a8328c92f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90d6caf-3936-4df9-8f87-69a8328c92f3', 'volume_size': 1} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-7ac37b02-d628-4023-98a7-42a15a58b488-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 1073741824" returned: 0 in 1.159s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:15 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-7ac37b02-d628-4023-98a7-42a15a58b488-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:16 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 Apr 17 16:02:16 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:16 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-7ac37b02-d628-4023-98a7-42a15a58b488" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.905s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:16 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Deleted volume successfully. Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-7ac37b02-d628-4023-98a7-42a15a58b488" acquired by "delete_volume" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-de29e705-5343-420a-bad0-299ef29a2aaf tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-e4cb2948-bdb6-4b1a-8a02-c623c22712b9-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7149bc-460a-455e-ae23-737d3b0039c6]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:16 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 Apr 17 16:02:16 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:16 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038" returned: 0 in 0.460s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.467s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687425054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c82c70e-80af-41e4-9b36-2eecd53e2c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Creating volume 6c82c70e-80af-41e4-9b36-2eecd53e2c2a {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:16 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52554c5-9fdb-4df9-a6e3-29d05483b159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c94de0-815a-4ebe-9784-310a13bd5038', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:16 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a 1073741824 Apr 17 16:02:16 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304b63fd-6b7a-407e-9571-a20bd188b744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:16 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume volume-b4c94de0-815a-4ebe-9784-310a13bd5038 (b4c94de0-815a-4ebe-9784-310a13bd5038): created successfully Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304b63fd-6b7a-407e-9571-a20bd188b744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (217b9db4-dd58-424c-9fea-a33053f274aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:16 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b81aa467-4d78-4aca-8dc8-09a539e54adb tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created volume successfully. Apr 17 16:02:16 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488" returned: 0 in 0.553s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:16 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:16 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488 Apr 17 16:02:16 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:17 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a 1073741824" returned: 0 in 0.593s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:17 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a Apr 17 16:02:17 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:17 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-7ac37b02-d628-4023-98a7-42a15a58b488" returned: 0 in 0.570s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-7ac37b02-d628-4023-98a7-42a15a58b488" released by "delete_volume" :: held 1.154s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Created reservations ['3094fdbf-8bc5-49a1-9c52-84f4b1759126', 'bff9ad52-384c-4f74-84f7-030c043789d0', '53b43510-10e0-4744-9da3-a3fcaccf83ce', '6a43dc60-9b13-4b7a-afa3-3944f2ea4025'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:17 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:17 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:17 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a" returned: 0 in 0.548s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.408s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-151900895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb64f3f8-fd84-4ce8-b432-3748d337a6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Creating volume bb64f3f8-fd84-4ce8-b432-3748d337a6dc {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:17 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe071c4-b477-4857-ac36-f485c099ae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:17 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc 1073741824 Apr 17 16:02:17 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8a7643-736d-44a7-8348-5b58832b27dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:17 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a (6c82c70e-80af-41e4-9b36-2eecd53e2c2a): created successfully Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8a7643-736d-44a7-8348-5b58832b27dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (61f700f6-98d5-41fd-ae7a-53bb2543eb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-48fc73b6-01ca-4739-910c-60481c907875 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created volume successfully. Apr 17 16:02:17 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.452s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:17 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Deleted volume successfully. Apr 17 16:02:17 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-69ea1411-8a50-4e72-9d51-72aec8b6ff1d tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-7ac37b02-d628-4023-98a7-42a15a58b488-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-feb4cbe4-000b-49a1-a005-f3a0902fbede-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-feb4cbe4-000b-49a1-a005-f3a0902fbede-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-feb4cbe4-000b-49a1-a005-f3a0902fbede" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-feb4cbe4-000b-49a1-a005-f3a0902fbede" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0c446-593e-4952-be40-195f3e006369]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:18 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede Apr 17 16:02:18 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:18 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc 1073741824" returned: 0 in 0.611s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:18 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc Apr 17 16:02:18 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:18 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede" returned: 0 in 0.523s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:18 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede Apr 17 16:02:18 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:18 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc" returned: 0 in 0.500s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.208s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004788373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce05d8ce-c327-4320-a103-640bdf1d3cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:15Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Creating volume ce05d8ce-c327-4320-a103-640bdf1d3cab {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:18 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788b5a6b-db29-4cb3-a445-e9341c0ebaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:18 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab 1073741824 Apr 17 16:02:18 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20c206d-3925-4ee8-9d59-b92472b6a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:18 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc (bb64f3f8-fd84-4ce8-b432-3748d337a6dc): created successfully Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20c206d-3925-4ee8-9d59-b92472b6a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:18 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (1394771b-4e63-4a73-b45d-f28b6301164c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:18 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-9f9b5de9-0328-400c-94b7-9688292f76c7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created volume successfully. Apr 17 16:02:19 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-feb4cbe4-000b-49a1-a005-f3a0902fbede" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-feb4cbe4-000b-49a1-a005-f3a0902fbede" released by "delete_volume" :: held 1.011s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Created reservations ['592ba79a-ed3b-414f-8775-8cbc9a20acd3', '6b2bce67-d7c7-4913-a7a6-76f5a0dedaa1', 'ee0c10d3-bcef-4d19-a213-369680848816', '9407c9d9-f076-4736-986a-26367ab3864b'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:19 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:19 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:19 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab 1073741824" returned: 0 in 0.596s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:19 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab Apr 17 16:02:19 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:19 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:19 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Deleted volume successfully. Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d1f11a5a-2abf-4eda-b38f-cbdce42f8bda tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-feb4cbe4-000b-49a1-a005-f3a0902fbede-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:19 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab" returned: 0 in 0.449s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.275s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:19 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Cloning volume a9acd73e-8c90-4c8f-9fa0-905819f4501d to volume eab24ed1-da5e-442e-9251-292feb7b251a Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097904f1-7868-403c-b043-db70e8ba5328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce05d8ce-c327-4320-a103-640bdf1d3cab', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5352eb-59be-420a-9369-be6387d35b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:19 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume volume-ce05d8ce-c327-4320-a103-640bdf1d3cab (ce05d8ce-c327-4320-a103-640bdf1d3cab): created successfully Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5352eb-59be-420a-9369-be6387d35b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (20a8d1c1-330e-428a-b459-95b322f93cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:19 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-4b681c9a-2816-4a5d-8245-41bb17cab8e1 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created volume successfully. Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Creating offline snapshot 317723d1-01ba-455a-a691-d3a87eed9c29 of volume a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62278154-31c6-47d0-ac47-d72f88e6fd46]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:19 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:20 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d Apr 17 16:02:20 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-72b40889-bd73-4c28-8856-61fec6707d16-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-72b40889-bd73-4c28-8856-61fec6707d16-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-72b40889-bd73-4c28-8856-61fec6707d16" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-72b40889-bd73-4c28-8856-61fec6707d16" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c33c22-622e-424e-a588-dbc4ab502212]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:20 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 Apr 17 16:02:20 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:20 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d" returned: 0 in 0.566s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:20 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 1G Apr 17 16:02:20 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:20 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16" returned: 0 in 0.596s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:20 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:21 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16 Apr 17 16:02:21 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:21 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 1G" returned: 0 in 0.616s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:21 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 Apr 17 16:02:21 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:21 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-72b40889-bd73-4c28-8856-61fec6707d16" returned: 0 in 0.502s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-72b40889-bd73-4c28-8856-61fec6707d16" released by "delete_volume" :: held 1.120s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Created reservations ['09c6a23e-3745-49ef-803d-6276404e2199', 'f4acf1d3-646a-4688-9350-cea5334bc6e8', '29fc2e8d-3c24-47a1-a7b9-c4af8450c7f4', 'a364452d-66d7-429c-8814-75c7f686eee9'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:21 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:21 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:21 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29" returned: 0 in 0.474s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:21 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 is being set with open permissions: ugo+rw Apr 17 16:02:21 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:21 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 Apr 17 16:02:21 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:22 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.457s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:22 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Deleted volume successfully. Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-06cfffe1-5861-4c5c-800c-a658dce58e51 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-72b40889-bd73-4c28-8856-61fec6707d16-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:22 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29" returned: 0 in 0.443s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:22 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.info Apr 17 16:02:22 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-1c0cb18e-179e-4f8e-90c7-530c0b2be4d3-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-1c0cb18e-179e-4f8e-90c7-530c0b2be4d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-a1e5c315-9e21-42a5-8064-5fb1afe079ed" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-a1e5c315-9e21-42a5-8064-5fb1afe079ed" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Deleting offline snapshot 1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 of volume a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] snapshot_file for this snap is: volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ea20f9-8ea8-4f0c-bead-69b0513bebcd]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:22 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.info" returned: 0 in 0.504s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:22 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.info is being set with open permissions: ugo+rw Apr 17 16:02:22 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:22 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.info Apr 17 16:02:22 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:22 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 Apr 17 16:02:22 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:23 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" returned: 0 in 0.555s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:23 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.info" returned: 0 in 0.521s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-eab24ed1-da5e-442e-9251-292feb7b251a" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45c9ec3-9b77-4298-bfb6-28b2efbf2374]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-eab24ed1-da5e-442e-9251-292feb7b251a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] snapshot: 317723d1-01ba-455a-a691-d3a87eed9c29, volume: eab24ed1-da5e-442e-9251-292feb7b251a, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c5a064-7398-480c-8430-b3d768501637]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:23 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed Apr 17 16:02:23 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:23 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 Apr 17 16:02:23 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:23 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed" returned: 0 in 0.546s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:23 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29" returned: 0 in 0.533s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f432ec41-4db0-4544-8ce7-99b1eb6bcaeb]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:23 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:23 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 Apr 17 16:02:23 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:23 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d Apr 17 16:02:23 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:24 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d" returned: 0 in 0.514s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:24 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" returned: 0 in 0.559s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:24 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a Apr 17 16:02:24 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:24 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3 Apr 17 16:02:24 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:24 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed.1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" returned: 0 in 0.468s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-1c0cb18e-179e-4f8e-90c7-530c0b2be4d3" released by "_delete_snapshot" :: held 2.197s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-a1e5c315-9e21-42a5-8064-5fb1afe079ed" released by "delete_snapshot" :: held 2.211s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Created reservations ['3ad1b86c-2156-4c0b-b129-32155ff78e66', 'bfe12707-8ec3-43d4-a097-a3cebda6be16', 'd6cfaf6a-030b-4ea3-86b2-decdd878facf', 'a253c125-6a5f-4d8b-8440-852931ed2962'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:24 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Delete snapshot completed successfully. Apr 17 16:02:24 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3ff68958-010e-4292-b79e-8b968a8feb37 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-1c0cb18e-179e-4f8e-90c7-530c0b2be4d3-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-a1e5c315-9e21-42a5-8064-5fb1afe079ed-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-a1e5c315-9e21-42a5-8064-5fb1afe079ed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "cinder-quobyte-a1e5c315-9e21-42a5-8064-5fb1afe079ed" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:25 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-a1e5c315-9e21-42a5-8064-5fb1afe079ed" acquired by "delete_volume" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:25 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e41413-a248-43b7-8f21-b38e4dbbef87]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:25 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:26 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed Apr 17 16:02:26 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:26 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a" returned: 0 in 2.370s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[168d1e83-9171-40c2-b885-a9a234117a69]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:26 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed" returned: 0 in 0.799s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:26 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed Apr 17 16:02:26 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:26 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d Apr 17 16:02:26 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Flow 'volume_create_manager' (4329295d-b6a0-4792-a3fc-d8f51c054234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0ce924-bbeb-4239-aa7b-002a404203f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0ce924-bbeb-4239-aa7b-002a404203f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1403487403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3127b7e3-cee3-42bb-a0f5-94273cfd60a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c68b62b3644518a682f89d932fcbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:27Z,use_quota=True,user_id='152db57018af495b84aabec050cb6c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d82bbe2-3183-4dff-97c8-a7f6971019ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d82bbe2-3183-4dff-97c8-a7f6971019ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3b7d00-9ca9-4713-828a-4ded93d2e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3b7d00-9ca9-4713-828a-4ded93d2e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3127b7e3-cee3-42bb-a0f5-94273cfd60a7', 'volume_name': 'volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d459441c-64a5-493f-bfc0-796d79112445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d459441c-64a5-493f-bfc0-796d79112445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bbb1f3-7c1d-42db-8eee-e1dcec1cb29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:26 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Volume 3127b7e3-cee3-42bb-a0f5-94273cfd60a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7', 'volume_size': 1} Apr 17 16:02:26 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:27 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a1e5c315-9e21-42a5-8064-5fb1afe079ed" returned: 0 in 0.417s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-quobyte-a1e5c315-9e21-42a5-8064-5fb1afe079ed" released by "delete_volume" :: held 1.273s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Created reservations ['5505b9a2-c8c7-4e7f-96c3-8d9031a617fa', 'd38bd851-48e3-49bc-bc53-c18689de05a9', 'e2dfc46b-3f0e-452a-8caf-7931b2b48548', 'fd6d2680-2299-41e6-a109-6eba2e7b569d'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:27 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:27 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:27 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d" returned: 0 in 0.653s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:02:27 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Converted 1024.00 MB image at 431.86 MB/s Apr 17 16:02:27 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a is being set with open permissions: ugo+rw Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:27 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a Apr 17 16:02:27 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:27 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.397s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:27 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Deleted volume successfully. Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-87c29028-7115-403f-8206-9255516d8947 tempest-CreateVolumesFromSnapshotTest-198911694 None] Lock "cinder-a1e5c315-9e21-42a5-8064-5fb1afe079ed-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:27 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a" returned: 0 in 0.426s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-eab24ed1-da5e-442e-9251-292feb7b251a" released by "_copy_volume_from_snapshot" :: held 4.542s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-317723d1-01ba-455a-a691-d3a87eed9c29" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-317723d1-01ba-455a-a691-d3a87eed9c29" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Deleting offline snapshot 317723d1-01ba-455a-a691-d3a87eed9c29 of volume a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] snapshot_file for this snap is: volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3232e23c-1b06-4d6c-8a21-140da6c91d94]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:27 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:27 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 Apr 17 16:02:27 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:28 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29" returned: 0 in 0.517s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:28 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:28 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a21c1c-68ba-42f3-a3e4-f15bd7bc7d69]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:28 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d Apr 17 16:02:28 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:28 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d" returned: 0 in 0.539s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:28 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:28 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 Apr 17 16:02:28 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:29 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29" returned: 0 in 0.451s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:29 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29 Apr 17 16:02:29 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:29 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d.317723d1-01ba-455a-a691-d3a87eed9c29" returned: 0 in 0.413s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-317723d1-01ba-455a-a691-d3a87eed9c29" released by "_delete_snapshot" :: held 1.972s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.826s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.780s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104334492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90d6caf-3936-4df9-8f87-69a8328c92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74ddc309894f76a58ffc6421435ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:16Z,use_quota=True,user_id='afa00423d81d42cca264be559f7c2245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Creating volume c90d6caf-3936-4df9-8f87-69a8328c92f3 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:29 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664aff0a-1d8d-4eef-8431-d67f22b70df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab24ed1-da5e-442e-9251-292feb7b251a', 'volume_size': 1, 'source_volid': 'a9acd73e-8c90-4c8f-9fa0-905819f4501d', 'source_volstatus': 'available'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:29 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 1073741824 Apr 17 16:02:29 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9967d4-6e6b-4a2d-9fda-104e5ba8ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:29 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Volume volume-eab24ed1-da5e-442e-9251-292feb7b251a (eab24ed1-da5e-442e-9251-292feb7b251a): created successfully Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9967d4-6e6b-4a2d-9fda-104e5ba8ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:29 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Flow 'volume_create_manager' (2e376ce9-dd1f-4749-9c6b-562c2d005dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:29 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ed45aa39-daae-43bc-b1ef-08f36fa0f9aa tempest-VolumeDependencyTests-1799001644 None] Created volume successfully. Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-a9acd73e-8c90-4c8f-9fa0-905819f4501d-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-a9acd73e-8c90-4c8f-9fa0-905819f4501d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:30 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 1073741824" returned: 0 in 0.513s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-a9acd73e-8c90-4c8f-9fa0-905819f4501d" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-a9acd73e-8c90-4c8f-9fa0-905819f4501d" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a5be86-c683-40e0-8f68-0bbe0a72c9b9]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:30 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 Apr 17 16:02:30 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:30 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d Apr 17 16:02:30 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:30 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.969s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1403487403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3127b7e3-cee3-42bb-a0f5-94273cfd60a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c68b62b3644518a682f89d932fcbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:27Z,use_quota=True,user_id='152db57018af495b84aabec050cb6c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)}" {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Creating volume 3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:30 devstack cinder-volume[81996]: INFO cinder.volume.drivers.remotefs [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] casted to osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 1073741824 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8356d-e310-4fd1-98f7-1d307572e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90d6caf-3936-4df9-8f87-69a8328c92f3', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2321dd8-cb23-4d5e-b32a-9dec4ffa996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:30 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 1073741824 Apr 17 16:02:30 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:30 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Volume volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 (c90d6caf-3936-4df9-8f87-69a8328c92f3): created successfully Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2321dd8-cb23-4d5e-b32a-9dec4ffa996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Flow 'volume_create_manager' (4d0a953e-db36-417c-bd1c-00d1f44d490d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:30 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d" returned: 0 in 0.495s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:30 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:30 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-0f37207e-375c-4d41-9400-5f8ac63bb453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created volume successfully. Apr 17 16:02:30 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d Apr 17 16:02:30 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:31 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-a9acd73e-8c90-4c8f-9fa0-905819f4501d" returned: 0 in 0.435s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-a9acd73e-8c90-4c8f-9fa0-905819f4501d" released by "delete_volume" :: held 0.967s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:31 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 1073741824" returned: 0 in 0.503s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Created reservations ['3cfc62bd-70e8-4edc-9f4f-c9424dcb0a44', '051a9ac2-5393-471a-bfad-4c1606661f33', '240b97a7-9e39-4548-aed0-bc6c78e9d9be', 'aa6a1015-c0e5-4c84-834a-34ec14f97dcf'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:31 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 Apr 17 16:02:31 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:31 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:31 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:31 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" returned: 0 in 0.400s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'} {{(pid=81996) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bbb1f3-7c1d-42db-8eee-e1dcec1cb29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7', 'volume_size': 1}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0c0b8a-7712-4b6e-97a9-2fa7b789ce65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:31 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Volume volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 (3127b7e3-cee3-42bb-a0f5-94273cfd60a7): created successfully Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0c0b8a-7712-4b6e-97a9-2fa7b789ce65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Flow 'volume_create_manager' (4329295d-b6a0-4792-a3fc-d8f51c054234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:31 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-28eda8f5-2267-41df-980a-3083d3aa6868 tempest-SnapshotDependencyTests-765136975 None] Created volume successfully. Apr 17 16:02:31 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.413s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:31 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Deleted volume successfully. Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-fbfa9f5e-3a30-495e-a0c9-d8d12f192efd tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-a9acd73e-8c90-4c8f-9fa0-905819f4501d-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-c90d6caf-3936-4df9-8f87-69a8328c92f3-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-c90d6caf-3936-4df9-8f87-69a8328c92f3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-quobyte-c90d6caf-3936-4df9-8f87-69a8328c92f3" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-c90d6caf-3936-4df9-8f87-69a8328c92f3" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc643e-144c-448c-be6a-992712d74bff]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:31 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:31 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 Apr 17 16:02:31 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Creating offline snapshot 67607a25-3db8-4059-bae2-2bb4caf9180e of volume 3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e00729-7a0c-4298-8791-f8fd81178323]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:32 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 Apr 17 16:02:32 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:32 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3" returned: 0 in 0.476s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:32 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3 Apr 17 16:02:32 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-eab24ed1-da5e-442e-9251-292feb7b251a-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-eab24ed1-da5e-442e-9251-292feb7b251a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-eab24ed1-da5e-442e-9251-292feb7b251a" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-eab24ed1-da5e-442e-9251-292feb7b251a" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f29db1-d372-4907-b65a-680024f3f6ec]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:32 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a Apr 17 16:02:32 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:32 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" returned: 0 in 0.491s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e 1G {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:32 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e 1G Apr 17 16:02:32 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:32 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-c90d6caf-3936-4df9-8f87-69a8328c92f3" returned: 0 in 0.417s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-c90d6caf-3936-4df9-8f87-69a8328c92f3" released by "delete_volume" :: held 0.924s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created reservations ['77b33fed-ba18-4d58-be05-da03323667a2', 'a3c1e836-8d4e-48fd-804c-1dc770ab4603', 'cde2852d-19f4-47b7-a4ff-959d3f83a356', 'f7898d4d-a73e-4641-b983-b9652440fda9'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:32 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:32 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-ce05d8ce-c327-4320-a103-640bdf1d3cab-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-ce05d8ce-c327-4320-a103-640bdf1d3cab-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:32 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a" returned: 0 in 0.507s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:32 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:33 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a Apr 17 16:02:33 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-quobyte-ce05d8ce-c327-4320-a103-640bdf1d3cab" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-ce05d8ce-c327-4320-a103-640bdf1d3cab" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2aaa75-d3ef-4625-a789-7251bd8ae1b2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:33 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab Apr 17 16:02:33 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:33 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e 1G" returned: 0 in 0.522s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:33 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e Apr 17 16:02:33 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:33 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.460s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:33 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Deleted volume successfully. Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-21160e8f-465c-4641-b6ea-ba4e3f07e9d2 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-c90d6caf-3936-4df9-8f87-69a8328c92f3-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:33 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-eab24ed1-da5e-442e-9251-292feb7b251a" returned: 0 in 0.513s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-eab24ed1-da5e-442e-9251-292feb7b251a" released by "delete_volume" :: held 1.044s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Created reservations ['1489b043-bb00-4370-acaa-de82cc57cd55', '60a42aa8-9213-40e9-a750-6a0241d67b99', '6c3a21d5-bd54-46db-a932-5f5089aaf7a3', 'bf8087f9-7ec2-45bc-89cf-af33fba66f20'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:33 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab" returned: 0 in 0.570s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:33 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:33 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:33 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab Apr 17 16:02:33 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:33 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 -F qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e" returned: 0 in 0.455s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:33 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e is being set with open permissions: ugo+rw Apr 17 16:02:33 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:33 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e Apr 17 16:02:33 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:34 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.414s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Deleted volume successfully. Apr 17 16:02:34 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e" returned: 0 in 0.397s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-aac543ea-a7dd-4399-9c31-e01592edcd9b tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-eab24ed1-da5e-442e-9251-292feb7b251a-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:34 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.info Apr 17 16:02:34 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:34 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-ce05d8ce-c327-4320-a103-640bdf1d3cab" returned: 0 in 0.483s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-ce05d8ce-c327-4320-a103-640bdf1d3cab" released by "delete_volume" :: held 1.075s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created reservations ['681520bf-7336-491d-950e-6a77dac7e168', 'baee2862-c378-465b-b157-bd081fd02192', '781fa2b9-5f2e-4c2f-aa8a-6843737b858c', '90b18818-2f76-48fd-8ee0-160b301269aa'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:34 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:34 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_service.periodic_task [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:34 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:34 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:34 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.info" returned: 0 in 0.425s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:34 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.info is being set with open permissions: ugo+rw Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.info {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:34 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.info Apr 17 16:02:34 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-6137e5a6-3e75-4fc9-a1d4-d612a4a67531-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-6137e5a6-3e75-4fc9-a1d4-d612a4a67531-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:34 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.478s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Deleted volume successfully. Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "cinder-quobyte-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-240f6f0a-0fb5-436b-b1b9-0ab292e2118f tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-ce05d8ce-c327-4320-a103-640bdf1d3cab-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5756c3-e7d6-4d64-8b8b-9ac9c935cbe4]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:34 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 Apr 17 16:02:34 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:34 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.425s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-1cf6793f-c29a-4d03-a0e9-3eaafefceb8b None None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:34 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.info" returned: 0 in 0.447s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:34 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:34 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-ea26aeb7-d995-4b36-885b-52cd4d1626dd tempest-SnapshotDependencyTests-765136975 None] Create snapshot completed successfully Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-bb64f3f8-fd84-4ce8-b432-3748d337a6dc-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-bb64f3f8-fd84-4ce8-b432-3748d337a6dc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-quobyte-bb64f3f8-fd84-4ce8-b432-3748d337a6dc" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-bb64f3f8-fd84-4ce8-b432-3748d337a6dc" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96623fb-4d0b-4e03-94f0-37dd62bad27a]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:35 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" returned: 0 in 0.503s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:35 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531 Apr 17 16:02:35 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:35 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc Apr 17 16:02:35 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81996) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Flow 'volume_create_manager' (ffc1889e-b287-43b3-9de3-8df97181118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ef6824-7b63-42bd-ab71-63116100a3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ef6824-7b63-42bd-ab71-63116100a3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-17T14:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afc2923-4505-49a9-af31-7c0236cc8762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c68b62b3644518a682f89d932fcbf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-17T14:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67607a25-3db8-4059-bae2-2bb4caf9180e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-17T14:02:36Z,use_quota=True,user_id='152db57018af495b84aabec050cb6c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4774cefa-6a4c-4dd6-b92c-24707eb414bc),volume_type_id=4774cefa-6a4c-4dd6-b92c-24707eb414bc)' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000f7e2b-7642-46d5-8bdd-d7075edba5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000f7e2b-7642-46d5-8bdd-d7075edba5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aa4159-4e01-4277-8a77-4b993cd2cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aa4159-4e01-4277-8a77-4b993cd2cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9afc2923-4505-49a9-af31-7c0236cc8762', 'volume_name': 'volume-9afc2923-4505-49a9-af31-7c0236cc8762', 'volume_size': 1, 'snapshot_id': '67607a25-3db8-4059-bae2-2bb4caf9180e'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb08231e-44ee-4d0d-8ae7-1bfe11937c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb08231e-44ee-4d0d-8ae7-1bfe11937c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037abcb1-2638-497b-b5a9-b5c46f86b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:35 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Volume 9afc2923-4505-49a9-af31-7c0236cc8762: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9afc2923-4505-49a9-af31-7c0236cc8762', 'volume_size': 1, 'snapshot_id': '67607a25-3db8-4059-bae2-2bb4caf9180e'} Apr 17 16:02:35 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-quobyte-67607a25-3db8-4059-bae2-2bb4caf9180e-9afc2923-4505-49a9-af31-7c0236cc8762" by "_create_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" returned: 0 in 0.486s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:35 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-quobyte-6137e5a6-3e75-4fc9-a1d4-d612a4a67531" released by "delete_volume" :: held 1.014s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-67607a25-3db8-4059-bae2-2bb4caf9180e-9afc2923-4505-49a9-af31-7c0236cc8762" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Creating volume 9afc2923-4505-49a9-af31-7c0236cc8762 from snapshot 67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Selected osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc as target Quobyte volume. {{(pid=81996) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-quobyte-9afc2923-4505-49a9-af31-7c0236cc8762" by "_copy_volume_from_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc" returned: 0 in 0.525s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:35 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc Apr 17 16:02:35 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-9afc2923-4505-49a9-af31-7c0236cc8762" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] snapshot: 67607a25-3db8-4059-bae2-2bb4caf9180e, volume: 9afc2923-4505-49a9-af31-7c0236cc8762, {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2173b264-45d4-4101-b762-7dfe96ffe5d8]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Created reservations ['1538453c-4c3b-4fea-9a76-603588af0001', 'a4acf778-9b8f-48d3-9345-90b7acd7103f', '7f81afdf-558e-4971-b0be-808a008b54d2', 'ea34eae8-949f-4382-979a-e8a056fca548'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:35 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:35 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e Apr 17 16:02:35 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:35 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:35 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:36 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-bb64f3f8-fd84-4ce8-b432-3748d337a6dc" returned: 0 in 0.393s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-bb64f3f8-fd84-4ce8-b432-3748d337a6dc" released by "delete_volume" :: held 0.956s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created reservations ['975bd386-771f-4187-9fed-d9341e792468', 'e15a58b2-1dcf-428d-a7ae-80a8cfe06f1d', 'a82a6ce4-1dcb-44ac-b9e4-1982b27cc25a', 'cf0a4034-4ad0-4c43-b111-5472d3e49099'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:36 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:36 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-6c82c70e-80af-41e4-9b36-2eecd53e2c2a-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-6c82c70e-80af-41e4-9b36-2eecd53e2c2a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:36 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:36 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e" returned: 0 in 0.523s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Creating direct copy from snapshot {{(pid=81996) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.470s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e5204-341c-414b-add2-5f11974d1cf2]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Deleted volume successfully. Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-quobyte-6c82c70e-80af-41e4-9b36-2eecd53e2c2a" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-6c82c70e-80af-41e4-9b36-2eecd53e2c2a" acquired by "delete_volume" :: waited 0.010s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-b1b4e448-68b6-41ad-9e7a-4b3fdc6ef04d tempest-VolumeDependencyTests-1799001644 None] Lock "cinder-6137e5a6-3e75-4fc9-a1d4-d612a4a67531-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5240dc-f2a9-4452-8c0a-8fce1ed8e883]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:36 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 Apr 17 16:02:36 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:36 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a Apr 17 16:02:36 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:36 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.495s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:36 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Deleted volume successfully. Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-abbdcee4-15fe-4fed-9444-9d056e460453 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-bb64f3f8-fd84-4ce8-b432-3748d337a6dc-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:36 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" returned: 0 in 0.527s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG cinder.utils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Path /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 not found in is_blk_device check {{(pid=81996) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:36 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 Apr 17 16:02:36 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:36 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a" returned: 0 in 0.546s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:36 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:36 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a Apr 17 16:02:36 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:37 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-6c82c70e-80af-41e4-9b36-2eecd53e2c2a" returned: 0 in 0.646s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-6c82c70e-80af-41e4-9b36-2eecd53e2c2a" released by "delete_volume" :: held 1.217s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created reservations ['ea5c627d-1843-4d01-b139-234c674e4ad8', 'e8a7e238-f1eb-48f9-8d5d-91c15616bae4', '64482bc1-730b-4b31-960a-6367a051c76b', '671582e1-88e0-4aaf-89a9-06db714d1f95'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:37 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:38 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:38 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-b4c94de0-815a-4ebe-9784-310a13bd5038-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-b4c94de0-815a-4ebe-9784-310a13bd5038-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-quobyte-b4c94de0-815a-4ebe-9784-310a13bd5038" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:38 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:38 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 1.071s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:38 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-b4c94de0-815a-4ebe-9784-310a13bd5038" acquired by "delete_volume" :: waited 0.041s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc1d8af-44df-41cf-b64a-1be538235a61]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:39 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Deleted volume successfully. Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-74b5997d-09df-444b-8e64-1597a2ff2d18 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-6c82c70e-80af-41e4-9b36-2eecd53e2c2a-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:39 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 Apr 17 16:02:39 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:39 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762" returned: 0 in 2.304s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[58524943-afbf-40da-afcf-0a6c372bd43e]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:39 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 Apr 17 16:02:39 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:39 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038" returned: 0 in 0.482s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:39 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038 Apr 17 16:02:39 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:39 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" returned: 0 in 0.601s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG cinder.image.image_utils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 {{(pid=81996) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 17 16:02:39 devstack cinder-volume[81996]: INFO cinder.image.image_utils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Converted 1024.00 MB image at 444.28 MB/s Apr 17 16:02:39 devstack cinder-volume[81996]: WARNING cinder.volume.drivers.remotefs [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 is being set with open permissions: ugo+rw Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:39 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 Apr 17 16:02:39 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:39 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-b4c94de0-815a-4ebe-9784-310a13bd5038" returned: 0 in 0.397s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-b4c94de0-815a-4ebe-9784-310a13bd5038" released by "delete_volume" :: held 0.920s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:39 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created reservations ['8db305fb-72fd-488f-99eb-7251ac7fa8c1', 'f36b260c-454d-4279-bbed-75b9ee756356', 'd33d8baa-b323-4723-9c10-8f0b640b0ffb', '6038d11e-8465-4c1a-92d4-22a33b194ef3'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:40 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:40 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-75d3b763-80d4-4b94-97db-a1679ab43ba3-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-75d3b763-80d4-4b94-97db-a1679ab43ba3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "cinder-quobyte-75d3b763-80d4-4b94-97db-a1679ab43ba3" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-75d3b763-80d4-4b94-97db-a1679ab43ba3" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3ae34f-54ce-46b5-8125-5b67c3e50e47]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:40 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762" returned: 0 in 0.412s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:40 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 Apr 17 16:02:40 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-9afc2923-4505-49a9-af31-7c0236cc8762" released by "_copy_volume_from_snapshot" :: held 4.437s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-67607a25-3db8-4059-bae2-2bb4caf9180e-9afc2923-4505-49a9-af31-7c0236cc8762" released by "_create_volume_from_snapshot" :: held 4.474s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.492s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037abcb1-2638-497b-b5a9-b5c46f86b16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afc2923-4505-49a9-af31-7c0236cc8762', 'volume_size': 1, 'snapshot_id': '67607a25-3db8-4059-bae2-2bb4caf9180e'}' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de0f7b9-440e-4171-998c-ab02432667c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 17 16:02:40 devstack cinder-volume[81996]: INFO cinder.volume.flows.manager.create_volume [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Volume volume-9afc2923-4505-49a9-af31-7c0236cc8762 (9afc2923-4505-49a9-af31-7c0236cc8762): created successfully Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de0f7b9-440e-4171-998c-ab02432667c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81996) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Flow 'volume_create_manager' (ffc1889e-b287-43b3-9de3-8df97181118d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81996) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 17 16:02:40 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-e7180980-db1c-444c-89df-649aa10054c9 tempest-SnapshotDependencyTests-765136975 None] Created volume successfully. Apr 17 16:02:40 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.437s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:40 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Deleted volume successfully. Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-3a8a7f38-7e1e-4242-b961-a171656db75d tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-b4c94de0-815a-4ebe-9784-310a13bd5038-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:40 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3" returned: 0 in 0.467s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:40 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3 Apr 17 16:02:40 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:40 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-75d3b763-80d4-4b94-97db-a1679ab43ba3" returned: 0 in 0.388s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:40 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-quobyte-75d3b763-80d4-4b94-97db-a1679ab43ba3" released by "delete_volume" :: held 0.892s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Created reservations ['d6c7ca70-7cd6-4c2b-a519-faf4832cea73', '856b2508-8901-464b-a7b8-2e3952974b61', '2223b784-3688-4d89-9f86-6ebeb7f58179', '27118997-6d8d-45d3-9f26-a82f70569fa7'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:41 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:41 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-67607a25-3db8-4059-bae2-2bb4caf9180e-delete_snapshot" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-67607a25-3db8-4059-bae2-2bb4caf9180e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-quobyte-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" by "delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-quobyte-67607a25-3db8-4059-bae2-2bb4caf9180e" by "_delete_snapshot" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-67607a25-3db8-4059-bae2-2bb4caf9180e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Deleting offline snapshot 67607a25-3db8-4059-bae2-2bb4caf9180e of volume 3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] snapshot_file for this snap is: volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[673a141e-8662-4e41-bc59-368f10b67f9c]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:41 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e Apr 17 16:02:41 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:41 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.473s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:41 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Deleted volume successfully. Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d022d519-f0ab-4cb1-8d0d-0f57a36a28b7 tempest-CreateVolumesFromSourceVolumeTest-2013066306 None] Lock "cinder-75d3b763-80d4-4b94-97db-a1679ab43ba3-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:41 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e" returned: 0 in 0.556s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.remotefs [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81996) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefcc481-989e-4543-9578-6495362b77fc]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:41 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:41 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 Apr 17 16:02:41 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:42 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" returned: 0 in 0.498s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:42 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e Apr 17 16:02:42 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:42 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e" returned: 0 in 0.454s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:42 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:42 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e Apr 17 16:02:42 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:43 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:43 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7.67607a25-3db8-4059-bae2-2bb4caf9180e" returned: 0 in 0.413s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-67607a25-3db8-4059-bae2-2bb4caf9180e" released by "_delete_snapshot" :: held 1.980s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" released by "delete_snapshot" :: held 1.998s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:43 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Created reservations ['48f84a77-f3e7-4055-9d3a-90aead690bb1', 'c6572cb7-3de0-462c-bcd1-7b1c5bb83d97', '27ec1af2-ee2d-4bd9-9be5-3bd4b361c54f', '85b268d7-ef7d-4923-baad-9f9899628bf9'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:43 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Delete snapshot completed successfully. Apr 17 16:02:43 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-382ba812-1a88-4447-94e0-66c4d7219752 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-67607a25-3db8-4059-bae2-2bb4caf9180e-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-3127b7e3-cee3-42bb-a0f5-94273cfd60a7-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-3127b7e3-cee3-42bb-a0f5-94273cfd60a7-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-quobyte-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" acquired by "delete_volume" :: waited 0.006s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f69888-a146-4cf3-8a52-5ea4c74df562]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:44 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 Apr 17 16:02:44 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:44 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" returned: 0 in 0.453s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:44 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:44 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7 Apr 17 16:02:44 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:45 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" returned: 0 in 0.392s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-3127b7e3-cee3-42bb-a0f5-94273cfd60a7" released by "delete_volume" :: held 0.881s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Created reservations ['4874568b-40c7-4735-a96c-fcef99512a55', 'c83aceff-cbed-42e8-a24f-cd0bbd420019', '739c1b6a-7ba5-4924-9110-19636915f43f', 'defa855b-4052-4fad-8288-9a2f25816727'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:45 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:45 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-9afc2923-4505-49a9-af31-7c0236cc8762-delete_volume" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-9afc2923-4505-49a9-af31-7c0236cc8762-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "cinder-quobyte-9afc2923-4505-49a9-af31-7c0236cc8762" by "delete_volume" {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-9afc2923-4505-49a9-af31-7c0236cc8762" acquired by "delete_volume" :: waited 0.007s {{(pid=81996) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e17882-79f4-424c-9be1-1284ffbeb98f]: (4, 'qcow2') {{(pid=82789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:45 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 Apr 17 16:02:45 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:45 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.422s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:45 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Deleted volume successfully. Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-d71598fb-644c-4863-8c3c-17495563c1e4 tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-3127b7e3-cee3-42bb-a0f5-94273cfd60a7-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:45 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762" returned: 0 in 0.464s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:45 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:45 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762 Apr 17 16:02:45 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:46 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b/volume-9afc2923-4505-49a9-af31-7c0236cc8762" returned: 0 in 0.391s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-quobyte-9afc2923-4505-49a9-af31-7c0236cc8762" released by "delete_volume" :: held 0.882s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG cinder.quota [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Created reservations ['b5266bfd-86d6-4213-a35a-c93f5978b1e7', '2d07ab42-12b6-4fe7-9051-df4682b04633', '21ab9e15-fd74-45d9-af11-8a0d90cb5482', '9be32163-14d9-4ed4-847b-a5a9e9a7fc48'] {{(pid=81996) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc': None} {{(pid=81996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG cinder.volume.drivers.quobyte [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-344b6df2-d39e-4e70-9eb3-308e6f57cacc'] {{(pid=81996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.lockutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 17 16:02:46 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b Apr 17 16:02:46 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 17 16:02:46 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG oslo_concurrency.processutils [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d2abb4b11e4ccc14bc7cb4f95f1762b" returned: 0 in 0.410s {{(pid=81996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG cinder.manager [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Notifying Schedulers of capabilities ... {{(pid=81996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 17 16:02:46 devstack cinder-volume[81996]: INFO cinder.volume.manager [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Deleted volume successfully. Apr 17 16:02:46 devstack cinder-volume[81996]: DEBUG cinder.coordination [None req-5a97ac26-a4c0-4c6b-bc8c-fa59881d182b tempest-SnapshotDependencyTests-765136975 None] Lock "cinder-9afc2923-4505-49a9-af31-7c0236cc8762-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=81996) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 17 16:02:56 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:SELECT=123,cinder:INSERT=40,cinder:UPDATE=172,cinder:DELETE=15 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 17 16:02:56 devstack cinder-volume[81996]: DEBUG dbcounter [-] [81996] Writing DB stats cinder:UPDATE=189,cinder:SELECT=122,cinder:INSERT=49,cinder:DELETE=14 {{(pid=81996) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}